Jul 21 18:53:51 devstack cinder-volume[76094]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 18:53:51 devstack cinder-volume[76094]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 18:53:51 devstack cinder-volume[76094]: we strongly recommend against using it for new projects. Jul 21 18:53:51 devstack cinder-volume[76094]: If you are already using Eventlet, we recommend migrating to a different Jul 21 18:53:51 devstack cinder-volume[76094]: framework. For more detail see Jul 21 18:53:51 devstack cinder-volume[76094]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 18:53:51 devstack cinder-volume[76094]: import eventlet # noqa Jul 21 18:53:54 devstack cinder-volume[76094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76094) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 18:53:54 devstack cinder-volume[76094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76094) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 18:53:54 devstack cinder-volume[76094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76094) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 18:53:55 devstack cinder-volume[76094]: INFO dbcounter [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Registered counter for database cinder Jul 21 18:53:55 devstack cinder-volume[76094]: DEBUG oslo_db.sqlalchemy.engines [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76094) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:53:55 devstack cinder-volume[76094]: DEBUG dbcounter [-] [76094] Writer thread running {{(pid=76094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 18:53:55 devstack cinder-volume[76094]: INFO cinder.rpc [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 18:53:55 devstack cinder-volume[76094]: INFO cinder.rpc [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 18:53:55 devstack cinder-volume[76094]: DEBUG oslo_db.sqlalchemy.engines [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76094) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:53:55 devstack cinder-volume[76094]: INFO cinder.volume.manager [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Determined volume DB was empty at startup. Jul 21 18:53:55 devstack cinder-volume[76094]: DEBUG cinder.volume.manager [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76094) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 18:53:55 devstack cinder-volume[76094]: INFO cinder.volume.manager [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 21 18:53:55 devstack cinder-volume[76094]: WARNING stevedore.named [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 18:53:55 devstack cinder-volume[76094]: WARNING castellan.key_manager [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 18:53:55 devstack cinder-volume[76094]: WARNING cinder.keymgr.conf_key_mgr [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 18:53:55 devstack cinder-volume[76094]: DEBUG cinder.volume.drivers.lvm [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76094) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 21 18:53:55 devstack cinder-volume[76094]: DEBUG oslo_concurrency.processutils [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_concurrency.processutils [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] CMD "cinder-rtstool verify" returned: 0 in 0.436s {{(pid=76094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_db.sqlalchemy.engines [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76094) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:53:56 devstack cinder-volume[76094]: INFO cinder.rpc [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 21 18:53:56 devstack cinder-volume[76094]: INFO cinder.rpc [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 21 18:53:56 devstack cinder-volume[76094]: WARNING stevedore.named [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 18:53:56 devstack cinder-volume[76094]: WARNING castellan.key_manager [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 18:53:56 devstack cinder-volume[76094]: INFO cinder.volume.manager [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_db.sqlalchemy.engines [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76094) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:53:56 devstack cinder-volume[76094]: INFO oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Starting 1 workers Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Started child 76250 {{(pid=76094) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Full set of CONF: {{(pid=76094) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] ******************************************************************************** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Configuration options gathered from: {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] ================================================================================ {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] allow_availability_zone_fallback = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] allow_compression_on_image_upload = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] allowed_direct_url_schemes = [] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] api_rate_limit = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] auth_strategy = keystone {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] az_cache_duration = 3600 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_availability_zone = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_host = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_name = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_stats_polling_interval = 60 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backup_api_class = cinder.backup.api.API {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backup_name_template = backup-%s {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backup_use_same_host = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backup_use_temp_snapshot = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] chap_password = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] chap_username = {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cinder_internal_tenant_project_id = 6a8b837f742340cd9feca1e4aa52535d {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cinder_internal_tenant_user_id = a67917e4c51643a785c078c062001b65 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cloned_volume_same_az = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cluster = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] compression_format = gzip {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] compute_api_class = cinder.compute.nova.API {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] config_dir = [] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] config_source = [] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] control_exchange = openstack {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] debug = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] default_availability_zone = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] default_group_type = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] default_volume_type = lvmdriver-1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] disk_geometry = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] driver_client_cert = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] driver_client_cert_key = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] driver_data_namespace = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] driver_ssl_cert_path = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] driver_ssl_cert_verify = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] driver_use_ssl = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] enable_force_upload = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76250]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] enable_new_services = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] enable_unsupported_driver = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] enabled_backends = ['lvmdriver-1'] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] enforce_multipath_for_image_xfer = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] filter_function = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance_api_insecure = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance_api_servers = ['http://192.168.122.96/image'] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance_api_ssl_compression = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance_ca_certificates_file = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance_catalog_info = image:glance:publicURL {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance_certfile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance_keyfile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance_num_retries = 3 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance_request_timeout = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] goodness_function = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] graceful_shutdown_timeout = 5 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] group_api_class = cinder.group.api.API {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] host = devstack {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] image_compress_on_upload = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] image_conversion_address_space_limit = 1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] image_conversion_cpu_limit = 60 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] image_conversion_disable = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] image_upload_use_cinder_backend = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] image_upload_use_internal_tenant = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] image_volume_cache_enabled = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] image_volume_cache_max_count = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] image_volume_cache_max_size_gb = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] init_host_max_objects_retrieval = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] instance_format = [instance: %(uuid)s] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] iscsi_target_flags = {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] iscsi_write_cache = on {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] iser_helper = tgtadm {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] iser_ip_address = 192.168.122.96 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] iser_port = 3260 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] log_color = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] log_config_append = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] log_dir = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] log_file = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] log_options = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] log_rotate_interval = 1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] log_rotate_interval_type = days {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] log_rotation_type = none {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] max_age = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] max_logfile_count = 30 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] max_logfile_size_mb = 200 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] max_over_subscription_ratio = 20.0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] message_reap_interval = 86400 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] message_ttl = 2592000 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] migration_create_volume_timeout_secs = 300 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] monkey_patch = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] monkey_patch_modules = [] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] my_ip = 192.168.122.96 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] no_snapshot_gb_quota = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] num_iser_scan_tries = 3 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] num_shell_tries = 3 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] num_volume_device_scan_tries = 3 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] nvmeof_conn_info_version = 1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] nvmet_ns_id = 10 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] nvmet_port_id = 1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] osapi_max_limit = 1000 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] osapi_volume_ext_list = [] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] osapi_volume_listen = 0.0.0.0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] osapi_volume_listen_port = 8776 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] osapi_volume_use_ssl = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] osapi_volume_workers = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] per_volume_size_limit = -1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] periodic_fuzzy_delay = 60 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] periodic_interval = 60 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] project_id_regex = [0-9a-f\-]+ {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] public_endpoint = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] publish_errors = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] quota_backup_gigabytes = 1000 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] quota_backups = 10 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] quota_gigabytes = 1000 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] quota_groups = 10 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] quota_snapshots = 10 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] quota_volumes = 10 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] rate_limit_burst = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] rate_limit_except_level = CRITICAL {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] rate_limit_interval = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] reinit_driver_count = 3 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] replication_device = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] report_discard_supported = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] report_interval = 120 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] reservation_clean_interval = 86400 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] reservation_expire = 86400 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] reserved_image_namespaces = [] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] reserved_percentage = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] rpc_response_timeout = 120 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] run_external_periodic_tasks = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] scst_target_driver = iscsi {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] scst_target_iqn_name = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] service_down_time = 720 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] shell_completion = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] snapshot_name_template = snapshot-%s {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] snapshot_same_host = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] split_loggers = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] state_path = /opt/stack/data/cinder {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] storage_availability_zone = nova {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] storage_protocol = iSCSI {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] syslog_log_facility = LOG_USER {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] target_helper = lioadm {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] target_ip_address = 192.168.122.96 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] target_port = 3260 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] target_protocol = iscsi {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] target_secondary_ip_addresses = [] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] trace_flags = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] transfer_api_class = cinder.transfer.api.API {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] transport_url = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76250]: INFO cinder.volume.manager [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 21 18:53:56 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] until_refresh = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] use_chap_auth = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] use_default_quota_class = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] use_journal = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] use_json = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] use_multipath_for_image_xfer = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] use_stderr = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] use_syslog = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] verify_glance_signatures = enabled {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] volume_api_class = cinder.volume.api.API {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] volume_backend_name = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] volume_clear = zero {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] volume_clear_ionice = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] volume_clear_size = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] volume_copy_bps_limit = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] volume_dd_blocksize = 1M {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] volume_name_template = volume-%s {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] volume_service_inithost_offload = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] volume_usage_audit_period = month {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] zoning_mode = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_concurrency.disable_process_locking = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.auth_section = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.auth_type = password {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.auth_version = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.cache = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.certfile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.delay_auth_decision = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.http_connect_timeout = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.include_service_catalog = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.insecure = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.interface = public {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.keyfile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.memcache_password = {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.memcache_username = {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.region_name = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.service_token_roles_required = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.service_type = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.token_cache_time = 300 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.96/identity {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.backend = dogpile.cache.null {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.backend_argument = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.backend_expiration_time = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.config_prefix = cache.oslo {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.debug_cache_backend = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.enable_retry_client = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.enable_socket_keepalive = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.enabled = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.expiration_time = 600 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.hashclient_retry_attempts = 2 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.memcache_dead_retry = 300 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.memcache_pool_maxsize = 10 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.memcache_sasl_enabled = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.password = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.proxies = [] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.redis_db = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.redis_sentinel_service_name = mymaster {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:56 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.redis_server = localhost:6379 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.retry_attempts = 2 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.retry_delay = 0.0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.socket_keepalive_count = 1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.socket_keepalive_idle = 1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.socket_keepalive_interval = 1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.socket_timeout = 1.0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.tls_allowed_ciphers = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.tls_cafile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.tls_certfile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.tls_enabled = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.tls_keyfile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cache.username = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] coordination.backend_url = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.asyncio_connection = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.asyncio_slave_connection = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.backend = sqlalchemy {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.connection = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.connection_debug = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.connection_parameters = {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.connection_recycle_time = 3600 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.connection_trace = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.db_inc_retry_interval = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.db_max_retries = 20 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.db_max_retry_interval = 10 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.db_retry_interval = 1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.max_overflow = 50 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.max_pool_size = 5 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.max_retries = 10 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.mysql_wsrep_sync_wait = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.pool_timeout = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.retry_interval = 10 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.slave_connection = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.sqlite_synchronous = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.synchronous_reader = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] database.use_db_reconnect = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] profiler.connection_string = messaging:// {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] profiler.enabled = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] profiler.es_doc_type = notification {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] profiler.es_scroll_size = 10000 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] profiler.es_scroll_time = 2m {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] profiler.filter_error_trace = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] profiler.hmac_keys = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] profiler.sentinel_service_name = mymaster {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] profiler.socket_timeout = 0.1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] profiler.trace_requests = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] profiler.trace_sqlalchemy = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] profiler_jaeger.process_tags = {} {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] profiler_jaeger.service_name_prefix = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] profiler_otlp.service_name_prefix = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_policy.enforce_new_defaults = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_policy.policy_default_rule = default {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_policy.policy_file = policy.yaml {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack sudo[76254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_policy.remote_timeout = 60.0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack sudo[76254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] privsep_osbrick.group = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] privsep_osbrick.helper_command = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] privsep_osbrick.user = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cinder_sys_admin.group = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cinder_sys_admin.helper_command = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] cinder_sys_admin.user = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] service_user.auth_section = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] service_user.auth_type = password {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] service_user.cafile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] service_user.certfile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] service_user.collect_timing = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] service_user.insecure = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] service_user.keyfile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] service_user.send_service_user_token = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] service_user.split_loggers = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] service_user.timeout = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance.auth_section = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance.auth_type = password {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance.certfile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance.collect_timing = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance.insecure = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance.keyfile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance.region_name = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance.split_loggers = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] glance.timeout = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.backend_availability_zone = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.chap_password = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.chap_username = {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.disk_geometry = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.driver_client_cert = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.driver_client_cert_key = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.driver_data_namespace = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.driver_use_ssl = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.enable_unsupported_driver = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.extra_capabilities = {} {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.filter_function = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.goodness_function = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.iscsi_target_flags = {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.iscsi_write_cache = on {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.iser_helper = tgtadm {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.iser_ip_address = 192.168.122.96 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.iser_port = 3260 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.lvm_mirrors = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.lvm_share_target = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.lvm_type = auto {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.num_shell_tries = 3 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.nvmet_port_id = 1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.replication_device = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.report_discard_supported = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.reserved_percentage = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.scst_target_driver = iscsi {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.scst_target_iqn_name = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.storage_protocol = iSCSI {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.target_helper = tgtadm {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.target_ip_address = 192.168.122.96 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.target_port = 3260 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.target_protocol = iscsi {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.trace_flags = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.unique_fqdn_network = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.use_chap_auth = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.volume_backend_name = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.volume_clear = zero {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.volume_clear_ionice = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.volume_clear_size = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.volume_group = cinder-volumes {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_reports.file_event_handler = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_reports.log_dir = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.backend_availability_zone = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.backend_host = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.chap_password = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.chap_username = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.chiscsi_conf = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.disk_geometry = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.driver_client_cert = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.driver_data_namespace = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.driver_use_ssl = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.extra_capabilities = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.filter_function = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.goodness_function = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.iser_helper = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.iser_ip_address = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.iser_port = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.iser_target_prefix = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.lvm_conf_file = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.lvm_mirrors = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.lvm_share_target = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.lvm_type = auto {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.num_shell_tries = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.nvmet_port_id = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.replication_device = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.report_discard_supported = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.reserved_percentage = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.scst_target_driver = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.storage_protocol = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.target_helper = lioadm {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.target_ip_address = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.target_port = 3260 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.target_protocol = iscsi {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.trace_flags = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.use_chap_auth = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.volume_clear = zero {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.volume_clear_size = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] lvmdriver-1.volumes_dir = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.ssl = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.ssl_version = {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_notifications.driver = [] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_notifications.retry = -1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] oslo_messaging_notifications.transport_url = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] key_manager.fixed_key = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican.barbican_api_version = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican.barbican_endpoint = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican.barbican_endpoint_type = public {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican.barbican_region_name = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican.cafile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican.certfile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican.collect_timing = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican.insecure = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican.keyfile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican.number_of_retries = 60 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican.retry_delay = 1 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican.send_service_user_token = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican.split_loggers = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican.timeout = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican.verify_ssl = True {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican.verify_ssl_path = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican_service_user.auth_section = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican_service_user.auth_type = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican_service_user.cafile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican_service_user.certfile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican_service_user.collect_timing = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican_service_user.insecure = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican_service_user.keyfile = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican_service_user.split_loggers = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] barbican_service_user.timeout = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] vault.approle_role_id = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] vault.approle_secret_id = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] vault.auth_method = approle {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] vault.auth_path = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] vault.kv_mountpoint = secret {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] vault.kv_path = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] vault.kv_version = 2 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] vault.namespace = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] vault.root_token_id = **** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] vault.ssl_ca_crt_file = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] vault.timeout = 60.0 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] vault.token_file = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] vault.token_role = None {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] vault.use_ssl = False {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:53:56 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] ******************************************************************************** {{(pid=76094) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 18:53:56 devstack sudo[76254]: pam_unix(sudo:session): session closed for user root Jul 21 18:53:56 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.359s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:56 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:56 devstack sudo[76259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:53:56 devstack sudo[76259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:53:57 devstack sudo[76259]: pam_unix(sudo:session): session closed for user root Jul 21 18:53:57 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.336s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:57 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 18:53:57 devstack cinder-volume[76250]: INFO cinder.brick.local_dev.lvm [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 21 18:53:57 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:57 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:57 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:57 devstack sudo[76303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:53:57 devstack sudo[76303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:53:57 devstack sudo[76303]: pam_unix(sudo:session): session closed for user root Jul 21 18:53:57 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:57 devstack cinder-volume[76250]: DEBUG cinder.brick.local_dev.lvm [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76250) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 21 18:53:57 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:57 devstack sudo[76427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:53:57 devstack sudo[76427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:53:58 devstack sudo[76427]: pam_unix(sudo:session): session closed for user root Jul 21 18:53:58 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.476s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:58 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:58 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:58 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:58 devstack sudo[76612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:53:58 devstack sudo[76612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:53:58 devstack sudo[76612]: pam_unix(sudo:session): session closed for user root Jul 21 18:53:58 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:58 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:58 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:58 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:58 devstack sudo[76713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 21 18:53:58 devstack sudo[76713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:53:58 devstack sudo[76713]: pam_unix(sudo:session): session closed for user root Jul 21 18:53:58 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.262s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:58 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:58 devstack sudo[76795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:53:58 devstack sudo[76795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:53:58 devstack sudo[76795]: pam_unix(sudo:session): session closed for user root Jul 21 18:53:58 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:58 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:58 devstack sudo[76873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:53:58 devstack sudo[76873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:53:59 devstack sudo[76873]: pam_unix(sudo:session): session closed for user root Jul 21 18:53:59 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:59 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:59 devstack sudo[76881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:53:59 devstack sudo[76881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:53:59 devstack sudo[76881]: pam_unix(sudo:session): session closed for user root Jul 21 18:53:59 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:59 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:59 devstack sudo[76959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:53:59 devstack sudo[76959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:53:59 devstack sudo[76959]: pam_unix(sudo:session): session closed for user root Jul 21 18:53:59 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:59 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:59 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:53:59 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:53:59 devstack sudo[76969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:53:59 devstack sudo[76969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:54:00 devstack sudo[76969]: pam_unix(sudo:session): session closed for user root Jul 21 18:54:00 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.325s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:54:00 devstack cinder-volume[76250]: INFO cinder.volume.drivers.lvm [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 21 18:54:00 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:54:00 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:54:00 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:54:00 devstack sudo[77053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:54:00 devstack sudo[77053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:54:00 devstack sudo[77053]: pam_unix(sudo:session): session closed for user root Jul 21 18:54:00 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:54:00 devstack cinder-volume[76250]: DEBUG cinder.volume.drivers.lvm [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Updating volume stats {{(pid=76250) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 18:54:00 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:54:00 devstack sudo[77056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:54:00 devstack sudo[77056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:54:00 devstack sudo[77056]: pam_unix(sudo:session): session closed for user root Jul 21 18:54:00 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:54:00 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:54:00 devstack sudo[77059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:54:00 devstack sudo[77059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:54:00 devstack sudo[77059]: pam_unix(sudo:session): session closed for user root Jul 21 18:54:00 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:54:00 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:54:00 devstack sudo[77062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:54:00 devstack sudo[77062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:54:01 devstack sudo[77062]: pam_unix(sudo:session): session closed for user root Jul 21 18:54:01 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:54:01 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:54:01 devstack sudo[77071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:54:01 devstack sudo[77071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:54:01 devstack sudo[77071]: pam_unix(sudo:session): session closed for user root Jul 21 18:54:01 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:54:01 devstack cinder-volume[76250]: INFO cinder.volume.driver [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Driver hasn't implemented _init_vendor_properties() Jul 21 18:54:01 devstack cinder-volume[76250]: DEBUG cinder.volume.driver [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76250) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 18:54:01 devstack cinder-volume[76250]: DEBUG oslo_db.sqlalchemy.engines [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76250) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:54:01 devstack cinder-volume[76250]: DEBUG dbcounter [-] [76250] Writer thread running {{(pid=76250) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 18:54:01 devstack cinder-volume[76250]: DEBUG cinder.db.api [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Building query based on filter {{(pid=76250) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 18:54:01 devstack cinder-volume[76250]: DEBUG cinder.image.image_utils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76250) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 18:54:01 devstack cinder-volume[76250]: INFO cinder.keymgr.migration [None req-74395d75-09b3-462c-a15c-e47f74677dee None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 18:54:01 devstack cinder-volume[76250]: DEBUG cinder.volume.drivers.lvm [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Updating volume stats {{(pid=76250) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 18:54:01 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:54:01 devstack sudo[77075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:54:01 devstack sudo[77075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:54:01 devstack sudo[77075]: pam_unix(sudo:session): session closed for user root Jul 21 18:54:01 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:54:01 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:54:01 devstack sudo[77078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:54:01 devstack sudo[77078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:54:02 devstack sudo[77078]: pam_unix(sudo:session): session closed for user root Jul 21 18:54:02 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:54:02 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:54:02 devstack sudo[77083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:54:02 devstack sudo[77083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:54:02 devstack sudo[77083]: pam_unix(sudo:session): session closed for user root Jul 21 18:54:02 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:54:02 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:54:02 devstack sudo[77087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:54:02 devstack sudo[77087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:54:02 devstack sudo[77087]: pam_unix(sudo:session): session closed for user root Jul 21 18:54:02 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:54:02 devstack cinder-volume[76250]: DEBUG cinder.manager [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Notifying Schedulers of capabilities ... {{(pid=76250) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 18:54:02 devstack cinder-volume[76250]: INFO cinder.volume.manager [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Driver initialization completed successfully. Jul 21 18:54:02 devstack cinder-volume[76250]: INFO cinder.manager [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Initiating service 2 cleanup Jul 21 18:54:02 devstack cinder-volume[76250]: INFO cinder.manager [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Service 2 cleanup completed. Jul 21 18:54:02 devstack cinder-volume[76250]: DEBUG cinder.service [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Creating RPC server for service cinder-volume {{(pid=76250) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 18:54:02 devstack cinder-volume[76250]: DEBUG cinder.service [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76250) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 18:54:02 devstack cinder-volume[76250]: INFO cinder.volume.manager [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 21 18:54:02 devstack cinder-volume[76250]: DEBUG cinder.volume.drivers.lvm [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Updating volume stats {{(pid=76250) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 18:54:02 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:54:02 devstack sudo[77091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:54:02 devstack sudo[77091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:54:03 devstack sudo[77091]: pam_unix(sudo:session): session closed for user root Jul 21 18:54:03 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:54:03 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:54:03 devstack sudo[77095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:54:03 devstack sudo[77095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:54:03 devstack sudo[77095]: pam_unix(sudo:session): session closed for user root Jul 21 18:54:03 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:54:03 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:54:03 devstack sudo[77098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:54:03 devstack sudo[77098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:54:03 devstack sudo[77098]: pam_unix(sudo:session): session closed for user root Jul 21 18:54:03 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:54:03 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:54:03 devstack sudo[77102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:54:03 devstack sudo[77102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:54:03 devstack sudo[77102]: pam_unix(sudo:session): session closed for user root Jul 21 18:54:03 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:54:04 devstack cinder-volume[76250]: INFO cinder.volume.manager [None req-9a5d234e-fe8e-4f0f-8e67-b1c9926b4fb4 None None] Driver post RPC initialization completed successfully. Jul 21 18:54:06 devstack cinder-volume[76094]: DEBUG dbcounter [-] [76094] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:54:13 devstack cinder-volume[76250]: DEBUG dbcounter [-] [76250] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76250) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:54:14 devstack cinder-volume[76250]: DEBUG dbcounter [-] [76250] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76250) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:54:48 devstack cinder-volume[76250]: DEBUG oslo_service.periodic_task [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running periodic task VolumeManager._thread_info {{(pid=76250) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 18:54:48 devstack cinder-volume[76250]: DEBUG cinder.volume.manager [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] thread count: 6 {{(pid=76250) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 18:54:48 devstack cinder-volume[76250]: DEBUG cinder.volume.manager [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] thread info: [<_MainThread(MainThread, started 125819690500224)>, , , , , ] {{(pid=76250) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 18:55:48 devstack cinder-volume[76250]: DEBUG oslo_service.periodic_task [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76250) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 18:55:48 devstack cinder-volume[76250]: DEBUG cinder.volume.drivers.lvm [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Updating volume stats {{(pid=76250) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 18:55:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:48 devstack sudo[82752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:55:48 devstack sudo[82752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:48 devstack sudo[82752]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:48 devstack sudo[82755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:55:48 devstack sudo[82755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:48 devstack sudo[82755]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:48 devstack sudo[82758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:55:48 devstack sudo[82758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:48 devstack sudo[82758]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:55:48 devstack sudo[82761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:55:48 devstack sudo[82761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:55:49 devstack sudo[82761]: pam_unix(sudo:session): session closed for user root Jul 21 18:55:49 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:55:49 devstack cinder-volume[76250]: DEBUG cinder.manager [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Notifying Schedulers of capabilities ... {{(pid=76250) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 18:55:49 devstack cinder-volume[76250]: DEBUG oslo_service.periodic_task [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running periodic task VolumeManager._thread_info {{(pid=76250) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 18:55:49 devstack cinder-volume[76250]: DEBUG cinder.volume.manager [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] thread count: 6 {{(pid=76250) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 18:55:49 devstack cinder-volume[76250]: DEBUG cinder.volume.manager [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] thread info: [<_MainThread(MainThread, started 125819690500224)>, , , , , ] {{(pid=76250) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 18:56:14 devstack cinder-volume[76250]: DEBUG dbcounter [-] [76250] Writing DB stats cinder:SELECT=1 {{(pid=76250) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:56:14 devstack cinder-volume[76250]: DEBUG dbcounter [-] [76250] Writing DB stats cinder:UPDATE=1 {{(pid=76250) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:56:48 devstack cinder-volume[76250]: DEBUG oslo_service.periodic_task [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76250) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 18:56:48 devstack cinder-volume[76250]: DEBUG cinder.volume.drivers.lvm [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Updating volume stats {{(pid=76250) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 18:56:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:56:48 devstack sudo[84503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:56:48 devstack sudo[84503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:56:48 devstack sudo[84503]: pam_unix(sudo:session): session closed for user root Jul 21 18:56:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:56:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:56:48 devstack sudo[84508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:56:48 devstack sudo[84508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:56:48 devstack sudo[84508]: pam_unix(sudo:session): session closed for user root Jul 21 18:56:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:56:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:56:48 devstack sudo[84526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:56:48 devstack sudo[84526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:56:48 devstack sudo[84526]: pam_unix(sudo:session): session closed for user root Jul 21 18:56:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:56:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:56:48 devstack sudo[84535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:56:48 devstack sudo[84535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:56:49 devstack sudo[84535]: pam_unix(sudo:session): session closed for user root Jul 21 18:56:49 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:56:49 devstack cinder-volume[76250]: DEBUG cinder.manager [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Notifying Schedulers of capabilities ... {{(pid=76250) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 18:56:49 devstack cinder-volume[76250]: DEBUG oslo_service.periodic_task [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running periodic task VolumeManager._thread_info {{(pid=76250) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 18:56:49 devstack cinder-volume[76250]: DEBUG cinder.volume.manager [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] thread count: 6 {{(pid=76250) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 18:56:49 devstack cinder-volume[76250]: DEBUG cinder.volume.manager [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] thread info: [<_MainThread(MainThread, started 125819690500224)>, , , , , ] {{(pid=76250) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 18:57:48 devstack cinder-volume[76250]: DEBUG oslo_service.periodic_task [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76250) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 18:57:48 devstack cinder-volume[76250]: DEBUG cinder.volume.drivers.lvm [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Updating volume stats {{(pid=76250) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 18:57:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:57:48 devstack sudo[85868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:57:48 devstack sudo[85868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:57:48 devstack sudo[85868]: pam_unix(sudo:session): session closed for user root Jul 21 18:57:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:57:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:57:48 devstack sudo[85872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:57:48 devstack sudo[85872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:57:48 devstack sudo[85872]: pam_unix(sudo:session): session closed for user root Jul 21 18:57:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:57:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:57:48 devstack sudo[85875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:57:48 devstack sudo[85875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:57:48 devstack sudo[85875]: pam_unix(sudo:session): session closed for user root Jul 21 18:57:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:57:48 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:57:48 devstack sudo[85889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:57:48 devstack sudo[85889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:57:49 devstack sudo[85889]: pam_unix(sudo:session): session closed for user root Jul 21 18:57:49 devstack cinder-volume[76250]: DEBUG oslo_concurrency.processutils [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76250) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:57:49 devstack cinder-volume[76250]: DEBUG cinder.manager [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Notifying Schedulers of capabilities ... {{(pid=76250) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 18:57:49 devstack cinder-volume[76250]: DEBUG oslo_service.periodic_task [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] Running periodic task VolumeManager._thread_info {{(pid=76250) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 18:57:49 devstack cinder-volume[76250]: DEBUG cinder.volume.manager [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] thread count: 6 {{(pid=76250) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 18:57:49 devstack cinder-volume[76250]: DEBUG cinder.volume.manager [None req-2fb7646d-6601-45a7-8188-a7a71f1994f9 None None] thread info: [<_MainThread(MainThread, started 125819690500224)>, , , , , ] {{(pid=76250) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 18:58:14 devstack cinder-volume[76250]: DEBUG dbcounter [-] [76250] Writing DB stats cinder:SELECT=1 {{(pid=76250) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:58:14 devstack cinder-volume[76250]: DEBUG dbcounter [-] [76250] Writing DB stats cinder:UPDATE=1 {{(pid=76250) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:58:24 devstack cinder-volume[76094]: INFO oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Caught SIGTERM, stopping children Jul 21 18:58:24 devstack cinder-volume[76094]: DEBUG oslo_concurrency.lockutils [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Acquiring lock "singleton_lock" {{(pid=76094) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 18:58:24 devstack cinder-volume[76094]: DEBUG oslo_concurrency.lockutils [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Acquired lock "singleton_lock" {{(pid=76094) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 18:58:24 devstack cinder-volume[76094]: DEBUG oslo_concurrency.lockutils [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Releasing lock "singleton_lock" {{(pid=76094) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 18:58:24 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Stop services. {{(pid=76094) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 21 18:58:24 devstack cinder-volume[76094]: DEBUG oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Killing children. {{(pid=76094) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 21 18:58:24 devstack cinder-volume[76094]: INFO oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Waiting on 1 children to exit Jul 21 18:58:27 devstack cinder-volume[76250]: DEBUG oslo_concurrency.lockutils [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Acquiring lock "singleton_lock" {{(pid=76250) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 18:58:27 devstack cinder-volume[76250]: DEBUG oslo_concurrency.lockutils [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Acquired lock "singleton_lock" {{(pid=76250) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 18:58:27 devstack cinder-volume[76250]: DEBUG oslo_concurrency.lockutils [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Releasing lock "singleton_lock" {{(pid=76250) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 18:58:27 devstack cinder-volume[76250]: WARNING amqp [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 18:58:27 devstack cinder-volume[76250]: WARNING amqp [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 18:58:27 devstack cinder-volume[76094]: INFO oslo_service.backend._eventlet.service [None req-e9f9d49c-8efa-4b29-b4d1-86bc35c2223f None None] Child 76250 exited with status 0 Jul 21 18:58:28 devstack cinder-volume[86770]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 18:58:28 devstack cinder-volume[86770]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 18:58:28 devstack cinder-volume[86770]: we strongly recommend against using it for new projects. Jul 21 18:58:28 devstack cinder-volume[86770]: If you are already using Eventlet, we recommend migrating to a different Jul 21 18:58:28 devstack cinder-volume[86770]: framework. For more detail see Jul 21 18:58:28 devstack cinder-volume[86770]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 18:58:28 devstack cinder-volume[86770]: import eventlet # noqa Jul 21 18:58:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 18:58:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 18:58:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 18:58:30 devstack cinder-volume[86770]: INFO dbcounter [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Registered counter for database cinder Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_db.sqlalchemy.engines [None req-323834ba-8295-4c87-84f9-5628860de972 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86770) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writer thread running {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 18:58:31 devstack cinder-volume[86770]: INFO cinder.rpc [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 18:58:31 devstack cinder-volume[86770]: INFO cinder.rpc [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_db.sqlalchemy.engines [None req-323834ba-8295-4c87-84f9-5628860de972 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86770) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:58:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Determined volume DB was empty at startup. Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86770) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 18:58:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 21 18:58:31 devstack cinder-volume[86770]: WARNING stevedore.named [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 18:58:31 devstack cinder-volume[86770]: WARNING castellan.key_manager [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 18:58:31 devstack cinder-volume[86770]: WARNING cinder.keymgr.conf_key_mgr [None req-323834ba-8295-4c87-84f9-5628860de972 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 18:58:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_db.sqlalchemy.engines [None req-323834ba-8295-4c87-84f9-5628860de972 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86770) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:58:31 devstack cinder-volume[86770]: INFO oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Starting 1 workers Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Started child 86984 {{(pid=86770) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Full set of CONF: {{(pid=86770) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] ******************************************************************************** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Configuration options gathered from: {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] ================================================================================ {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] allow_availability_zone_fallback = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] allow_compression_on_image_upload = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] allowed_direct_url_schemes = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] api_rate_limit = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] auth_strategy = keystone {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_availability_zone = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_host = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_stats_polling_interval = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backup_api_class = cinder.backup.api.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backup_name_template = backup-%s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backup_use_same_host = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backup_use_temp_snapshot = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] chap_password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] chap_username = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cinder_internal_tenant_project_id = 6a8b837f742340cd9feca1e4aa52535d {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cinder_internal_tenant_user_id = a67917e4c51643a785c078c062001b65 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cluster = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] compression_format = gzip {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] compute_api_class = cinder.compute.nova.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] config_dir = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] config_source = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] control_exchange = openstack {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] debug = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] default_availability_zone = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] default_group_type = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] default_volume_type = QuobyteHD {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86984]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] disk_geometry = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] driver_client_cert = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] driver_client_cert_key = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] driver_data_namespace = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] driver_ssl_cert_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] driver_ssl_cert_verify = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] driver_use_ssl = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] enable_new_services = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] enable_unsupported_driver = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] enabled_backends = ['QuobyteHD'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] enforce_multipath_for_image_xfer = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] filter_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance_api_insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance_api_servers = ['http://192.168.122.96/image'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance_api_ssl_compression = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance_ca_certificates_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance_catalog_info = image:glance:publicURL {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance_certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance_keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance_num_retries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance_request_timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] goodness_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] graceful_shutdown_timeout = 5 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] group_api_class = cinder.group.api.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] host = devstack {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] image_compress_on_upload = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] image_conversion_address_space_limit = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] image_conversion_cpu_limit = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] image_conversion_disable = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] image_upload_use_cinder_backend = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] image_upload_use_internal_tenant = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] image_volume_cache_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] image_volume_cache_max_count = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] image_volume_cache_max_size_gb = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] init_host_max_objects_retrieval = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] instance_format = [instance: %(uuid)s] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] iscsi_target_flags = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] iscsi_write_cache = on {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] iser_helper = tgtadm {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] iser_ip_address = 192.168.122.96 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] iser_port = 3260 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] log_color = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] log_config_append = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] log_dir = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] log_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] log_options = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] log_rotate_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] log_rotate_interval_type = days {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] log_rotation_type = none {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] max_age = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] max_logfile_count = 30 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] max_logfile_size_mb = 200 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] max_over_subscription_ratio = 20.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] message_reap_interval = 86400 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] message_ttl = 2592000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] migration_create_volume_timeout_secs = 300 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] monkey_patch = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] monkey_patch_modules = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] my_ip = 192.168.122.96 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] no_snapshot_gb_quota = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] num_iser_scan_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] num_shell_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] num_volume_device_scan_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] nvmeof_conn_info_version = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] nvmet_ns_id = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] nvmet_port_id = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] osapi_max_limit = 1000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] osapi_volume_ext_list = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] osapi_volume_listen_port = 8776 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] osapi_volume_use_ssl = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] osapi_volume_workers = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] per_volume_size_limit = -1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] periodic_fuzzy_delay = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] periodic_interval = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] public_endpoint = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] publish_errors = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] quota_backup_gigabytes = 1000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] quota_backups = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] quota_gigabytes = 1000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] quota_groups = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] quota_snapshots = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] quota_volumes = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] rate_limit_burst = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] rate_limit_except_level = CRITICAL {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] rate_limit_interval = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] reinit_driver_count = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] replication_device = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] report_discard_supported = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] report_interval = 120 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] reservation_clean_interval = 86400 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] reservation_expire = 86400 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] reserved_image_namespaces = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] reserved_percentage = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] rpc_response_timeout = 120 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] run_external_periodic_tasks = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] scst_target_driver = iscsi {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] scst_target_iqn_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] service_down_time = 720 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] shell_completion = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] snapshot_name_template = snapshot-%s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] split_loggers = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] state_path = /opt/stack/data/cinder {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] storage_availability_zone = nova {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] storage_protocol = iSCSI {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] syslog_log_facility = LOG_USER {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] target_helper = lioadm {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] target_ip_address = 192.168.122.96 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] target_port = 3260 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] target_protocol = iscsi {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] target_secondary_ip_addresses = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] trace_flags = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] transport_url = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] until_refresh = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] use_chap_auth = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] use_default_quota_class = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] use_journal = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] use_json = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] use_multipath_for_image_xfer = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] use_stderr = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] use_syslog = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] verify_glance_signatures = enabled {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] volume_api_class = cinder.volume.api.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] volume_backend_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] volume_clear = zero {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] volume_clear_ionice = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] volume_clear_size = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] volume_copy_bps_limit = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] volume_dd_blocksize = 1M {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] volume_name_template = volume-%s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] volume_service_inithost_offload = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] volume_usage_audit_period = month {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] zoning_mode = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_concurrency.disable_process_locking = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.auth_section = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.auth_type = password {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.auth_version = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.cache = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.include_service_catalog = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.interface = public {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.memcache_password = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Starting volume driver QuobyteDriver (1.2) Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86984) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.memcache_username = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.region_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.service_type = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.96/identity {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.backend = dogpile.cache.null {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.backend_argument = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.backend_expiration_time = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.config_prefix = cache.oslo {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.debug_cache_backend = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.enable_retry_client = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.enable_socket_keepalive = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.expiration_time = 600 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.hashclient_retry_attempts = 2 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.memcache_dead_retry = 300 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.memcache_pool_maxsize = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.memcache_sasl_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.proxies = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.redis_db = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.redis_server = localhost:6379 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.retry_attempts = 2 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.retry_delay = 0.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.socket_keepalive_count = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.socket_keepalive_idle = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.socket_keepalive_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.socket_timeout = 1.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.tls_allowed_ciphers = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.tls_cafile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.tls_certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.tls_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.tls_keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cache.username = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] coordination.backend_url = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.asyncio_connection = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.asyncio_slave_connection = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.backend = sqlalchemy {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.connection = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.connection_debug = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.connection_parameters = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.connection_recycle_time = 3600 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.connection_trace = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.db_inc_retry_interval = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.db_max_retries = 20 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.db_max_retry_interval = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.db_retry_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.max_overflow = 50 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.max_pool_size = 5 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.max_retries = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.mysql_wsrep_sync_wait = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.pool_timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.retry_interval = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.slave_connection = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.sqlite_synchronous = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.synchronous_reader = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] database.use_db_reconnect = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] profiler.connection_string = messaging:// {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] profiler.enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] profiler.es_doc_type = notification {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] profiler.es_scroll_size = 10000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] profiler.es_scroll_time = 2m {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] profiler.filter_error_trace = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] profiler.hmac_keys = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] profiler.sentinel_service_name = mymaster {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] profiler.socket_timeout = 0.1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] profiler.trace_requests = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] profiler.trace_sqlalchemy = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] profiler_jaeger.process_tags = {} {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] profiler_jaeger.service_name_prefix = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] profiler_otlp.service_name_prefix = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_policy.enforce_new_defaults = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_policy.policy_default_rule = default {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_policy.policy_file = policy.yaml {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] privsep_osbrick.group = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] privsep_osbrick.helper_command = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] privsep_osbrick.user = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cinder_sys_admin.group = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cinder_sys_admin.helper_command = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] cinder_sys_admin.user = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] service_user.auth_section = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] service_user.auth_type = password {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] service_user.cafile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] service_user.certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] service_user.collect_timing = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] service_user.insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] service_user.keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] service_user.send_service_user_token = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] service_user.split_loggers = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] service_user.timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance.auth_section = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance.auth_type = password {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance.certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance.collect_timing = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance.insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance.keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance.region_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance.split_loggers = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] glance.timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.backend_availability_zone = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86984) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 21 18:58:31 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.quobyte [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 21 18:58:31 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.quobyte [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.chap_password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.chap_username = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Running cmd (subprocess): mount.quobyte {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.disk_geometry = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.driver_client_cert = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.driver_client_cert_key = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.driver_data_namespace = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.driver_use_ssl = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.extra_capabilities = {} {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.filter_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.goodness_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.iscsi_target_flags = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.iscsi_write_cache = on {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.iser_helper = tgtadm {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.iser_ip_address = 192.168.122.96 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.iser_port = 3260 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.nas_host = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.nas_login = admin {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.nas_mount_options = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.nas_password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.nas_private_key = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.nas_share_path = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.num_shell_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.quobyte_volume_url = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.replication_device = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.report_discard_supported = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.reserved_percentage = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.target_helper = tgtadm {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.target_ip_address = 192.168.122.96 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.target_port = 3260 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.target_protocol = iscsi {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.trace_flags = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.unique_fqdn_network = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.use_chap_auth = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.volume_backend_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.volume_clear = zero {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.volume_clear_ionice = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.volume_clear_size = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_reports.file_event_handler = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_reports.log_dir = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.backend_availability_zone = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.backend_host = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.chap_password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.chap_username = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.chiscsi_conf = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.disk_geometry = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.driver_client_cert = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.driver_data_namespace = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.driver_use_ssl = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.extra_capabilities = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.filter_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.goodness_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack quobyte-client[86989]: Reading configuration file: /etc/quobyte/client.cfg Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.iser_helper = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.iser_ip_address = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.iser_port = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.iser_target_prefix = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack quobyte-client[86989]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.nas_host = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.nas_login = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.nas_mount_options = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.nas_password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.nas_private_key = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.nas_share_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.nas_ssh_port = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.num_shell_tries = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.nvmet_port_id = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] CMD "mount.quobyte" returned: 1 in 0.092s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.replication_device = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.report_discard_supported = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.reserved_percentage = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.scst_target_driver = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.storage_protocol = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.target_helper = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.target_ip_address = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.target_port = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86984]: INFO cinder.volume.drivers.quobyte [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 ... Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 -c /etc/quobyte/client-cinder.cfg {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.target_prefix = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.target_protocol = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.trace_flags = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.use_chap_auth = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.volume_clear = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.volume_clear_size = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] QuobyteHD.volumes_dir = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.ssl = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_notifications.driver = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_notifications.retry = -1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] key_manager.fixed_key = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican.barbican_api_version = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican.barbican_endpoint = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican.barbican_endpoint_type = public {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican.barbican_region_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican.cafile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican.certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican.collect_timing = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican.insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican.keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican.number_of_retries = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican.retry_delay = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican.send_service_user_token = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican.split_loggers = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican.timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican.verify_ssl = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican.verify_ssl_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican_service_user.auth_section = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican_service_user.auth_type = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican_service_user.cafile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican_service_user.certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican_service_user.collect_timing = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican_service_user.insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican_service_user.keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican_service_user.split_loggers = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] barbican_service_user.timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] vault.approle_role_id = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] vault.approle_secret_id = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] vault.auth_method = approle {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] vault.auth_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] vault.kv_mountpoint = secret {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] vault.kv_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] vault.kv_version = 2 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] vault.namespace = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] vault.root_token_id = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] vault.ssl_ca_crt_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] vault.timeout = 60.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] vault.token_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] vault.token_role = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] vault.use_ssl = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:32 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] ******************************************************************************** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 18:58:32 devstack sudo[86990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 -c /etc/quobyte/client-cinder.cfg Jul 21 18:58:32 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:58:32 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.384s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:58:32 devstack cinder-volume[86984]: INFO cinder.volume.drivers.quobyte [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 succeeded Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.399s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:58:32 devstack sudo[87059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 18:58:32 devstack sudo[87059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:58:32 devstack sudo[87059]: pam_unix(sudo:session): session closed for user root Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.240s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:58:32 devstack cinder-volume[86984]: INFO cinder.volume.driver [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Driver hasn't implemented _init_vendor_properties() Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG cinder.volume.driver [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86984) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG oslo_db.sqlalchemy.engines [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86984) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writer thread running {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG cinder.db.api [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Building query based on filter {{(pid=86984) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86984) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 18:58:32 devstack cinder-volume[86984]: INFO cinder.keymgr.migration [None req-afcfe169-440e-4b66-a24d-b90c23b7fb68 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 18:58:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:58:32 devstack sudo[87063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 18:58:32 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:58:33 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root Jul 21 18:58:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.247s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:58:33 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 18:58:33 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Driver initialization completed successfully. Jul 21 18:58:33 devstack cinder-volume[86984]: INFO cinder.manager [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Initiating service 3 cleanup Jul 21 18:58:33 devstack cinder-volume[86984]: INFO cinder.manager [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Service 3 cleanup completed. Jul 21 18:58:33 devstack cinder-volume[86984]: DEBUG cinder.service [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Creating RPC server for service cinder-volume {{(pid=86984) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 18:58:33 devstack cinder-volume[86984]: DEBUG cinder.service [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86984) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 18:58:33 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 21 18:58:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 18:58:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 18:58:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 18:58:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 18:58:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 18:58:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:58:33 devstack sudo[87066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 18:58:33 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:58:33 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root Jul 21 18:58:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.261s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:58:33 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-20483095-83ab-415b-ae00-aa9100e67de0 None None] Driver post RPC initialization completed successfully. Jul 21 18:58:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-62ec1f91-f4ec-404a-8ffb-a70e26c1aa60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 18:58:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-62ec1f91-f4ec-404a-8ffb-a70e26c1aa60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 18:58:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-62ec1f91-f4ec-404a-8ffb-a70e26c1aa60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 18:58:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-62ec1f91-f4ec-404a-8ffb-a70e26c1aa60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 18:58:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-62ec1f91-f4ec-404a-8ffb-a70e26c1aa60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 18:58:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-62ec1f91-f4ec-404a-8ffb-a70e26c1aa60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:58:38 devstack sudo[87219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 18:58:38 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:58:38 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root Jul 21 18:58:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-62ec1f91-f4ec-404a-8ffb-a70e26c1aa60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.250s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:58:38 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-62ec1f91-f4ec-404a-8ffb-a70e26c1aa60 None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 18:58:38 devstack cinder-volume[86770]: INFO oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Caught SIGTERM, stopping children Jul 21 18:58:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Acquiring lock "singleton_lock" {{(pid=86770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 18:58:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Acquired lock "singleton_lock" {{(pid=86770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 18:58:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Releasing lock "singleton_lock" {{(pid=86770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 18:58:38 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Stop services. {{(pid=86770) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 21 18:58:38 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Killing children. {{(pid=86770) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 21 18:58:38 devstack cinder-volume[86770]: INFO oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Waiting on 1 children to exit Jul 21 18:58:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Acquiring lock "singleton_lock" {{(pid=86984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 18:58:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Acquired lock "singleton_lock" {{(pid=86984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 18:58:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Releasing lock "singleton_lock" {{(pid=86984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 18:58:41 devstack cinder-volume[86984]: WARNING amqp [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 18:58:41 devstack cinder-volume[86984]: WARNING amqp [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 18:58:41 devstack cinder-volume[86770]: INFO oslo_service.backend._eventlet.service [None req-323834ba-8295-4c87-84f9-5628860de972 None None] Child 86984 exited with status 0 Jul 21 18:58:42 devstack cinder-volume[87272]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 18:58:42 devstack cinder-volume[87272]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 18:58:42 devstack cinder-volume[87272]: we strongly recommend against using it for new projects. Jul 21 18:58:42 devstack cinder-volume[87272]: If you are already using Eventlet, we recommend migrating to a different Jul 21 18:58:42 devstack cinder-volume[87272]: framework. For more detail see Jul 21 18:58:42 devstack cinder-volume[87272]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 18:58:42 devstack cinder-volume[87272]: import eventlet # noqa Jul 21 18:58:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87272) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 18:58:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87272) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 18:58:45 devstack cinder-volume[87272]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87272) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 18:58:45 devstack cinder-volume[87272]: INFO dbcounter [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] Registered counter for database cinder Jul 21 18:58:45 devstack cinder-volume[87272]: DEBUG oslo_db.sqlalchemy.engines [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87272) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writer thread running {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 18:58:46 devstack cinder-volume[87272]: INFO cinder.rpc [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 18:58:46 devstack cinder-volume[87272]: INFO cinder.rpc [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_db.sqlalchemy.engines [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87272) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:58:46 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] Determined volume DB was empty at startup. Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG cinder.volume.manager [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87272) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 18:58:46 devstack cinder-volume[87272]: WARNING stevedore.named [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 18:58:46 devstack cinder-volume[87272]: WARNING castellan.key_manager [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 18:58:46 devstack cinder-volume[87272]: WARNING cinder.keymgr.conf_key_mgr [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 18:58:46 devstack cinder-volume[87272]: INFO cinder.volume.manager [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_db.sqlalchemy.engines [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87272) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:58:46 devstack cinder-volume[87272]: INFO oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] Starting 1 workers Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] Started child 87570 {{(pid=87272) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] Full set of CONF: {{(pid=87272) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] ******************************************************************************** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] Configuration options gathered from: {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 18:58:46 devstack cinder-volume[87570]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] ================================================================================ {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] allow_availability_zone_fallback = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] allow_compression_on_image_upload = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] allowed_direct_url_schemes = [] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] api_rate_limit = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] auth_strategy = keystone {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_availability_zone = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_host = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_name = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_stats_polling_interval = 60 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backup_api_class = cinder.backup.api.API {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backup_name_template = backup-%s {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backup_use_same_host = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backup_use_temp_snapshot = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] chap_password = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] chap_username = {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cinder_internal_tenant_project_id = 6a8b837f742340cd9feca1e4aa52535d {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cinder_internal_tenant_user_id = a67917e4c51643a785c078c062001b65 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cluster = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] compression_format = gzip {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] compute_api_class = cinder.compute.nova.API {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] config_dir = [] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] config_source = [] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] control_exchange = openstack {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] debug = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] default_availability_zone = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] default_group_type = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] default_volume_type = QuobyteHD {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] disk_geometry = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] driver_client_cert = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] driver_client_cert_key = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] driver_data_namespace = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] driver_ssl_cert_path = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] driver_ssl_cert_verify = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] driver_use_ssl = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] enable_new_services = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] enable_unsupported_driver = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] enabled_backends = ['QuobyteHD'] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] enforce_multipath_for_image_xfer = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] filter_function = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance_api_insecure = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance_api_servers = ['http://192.168.122.96/image'] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance_api_ssl_compression = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance_ca_certificates_file = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance_catalog_info = image:glance:publicURL {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance_certfile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance_keyfile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance_num_retries = 3 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance_request_timeout = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] goodness_function = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] graceful_shutdown_timeout = 5 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] group_api_class = cinder.group.api.API {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] host = devstack {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] image_compress_on_upload = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] image_conversion_address_space_limit = 1 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] image_conversion_cpu_limit = 60 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] image_conversion_disable = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] image_upload_use_cinder_backend = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] image_upload_use_internal_tenant = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] image_volume_cache_enabled = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] image_volume_cache_max_count = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] image_volume_cache_max_size_gb = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] init_host_max_objects_retrieval = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] instance_format = [instance: %(uuid)s] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] iscsi_target_flags = {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] iscsi_write_cache = on {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] iser_helper = tgtadm {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] iser_ip_address = 192.168.122.96 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] iser_port = 3260 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Starting volume driver QuobyteDriver (1.2) Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] log_color = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87570) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] log_config_append = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] log_dir = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] log_file = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] log_options = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] log_rotate_interval = 1 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] log_rotate_interval_type = days {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] log_rotation_type = none {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] max_age = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] max_logfile_count = 30 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] max_logfile_size_mb = 200 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] max_over_subscription_ratio = 20.0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] message_reap_interval = 86400 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] message_ttl = 2592000 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] migration_create_volume_timeout_secs = 300 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] monkey_patch = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] monkey_patch_modules = [] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] my_ip = 192.168.122.96 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] no_snapshot_gb_quota = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] num_iser_scan_tries = 3 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] num_shell_tries = 3 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] num_volume_device_scan_tries = 3 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] nvmeof_conn_info_version = 1 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] nvmet_ns_id = 10 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] nvmet_port_id = 1 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] osapi_max_limit = 1000 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] osapi_volume_ext_list = [] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] osapi_volume_listen_port = 8776 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] osapi_volume_use_ssl = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] osapi_volume_workers = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] per_volume_size_limit = -1 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] periodic_fuzzy_delay = 60 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] periodic_interval = 60 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] public_endpoint = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] publish_errors = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] quota_backup_gigabytes = 1000 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] quota_backups = 10 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] quota_gigabytes = 1000 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] quota_groups = 10 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] quota_snapshots = 10 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] quota_volumes = 10 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] rate_limit_burst = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] rate_limit_except_level = CRITICAL {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] rate_limit_interval = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] reinit_driver_count = 3 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] replication_device = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] report_discard_supported = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] report_interval = 120 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] reservation_clean_interval = 86400 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] reservation_expire = 86400 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] reserved_image_namespaces = [] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] reserved_percentage = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] rpc_response_timeout = 120 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] run_external_periodic_tasks = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] scst_target_driver = iscsi {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] scst_target_iqn_name = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] service_down_time = 720 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] shell_completion = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] snapshot_name_template = snapshot-%s {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] split_loggers = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] state_path = /opt/stack/data/cinder {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] storage_availability_zone = nova {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] storage_protocol = iSCSI {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] syslog_log_facility = LOG_USER {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] target_helper = lioadm {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] target_ip_address = 192.168.122.96 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] target_port = 3260 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] target_protocol = iscsi {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] target_secondary_ip_addresses = [] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] trace_flags = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] transport_url = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] until_refresh = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] use_chap_auth = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] use_default_quota_class = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] use_journal = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] use_json = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] use_multipath_for_image_xfer = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] use_stderr = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] use_syslog = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] verify_glance_signatures = enabled {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] volume_api_class = cinder.volume.api.API {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] volume_backend_name = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] volume_clear = zero {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] volume_clear_ionice = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] volume_clear_size = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] volume_copy_bps_limit = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] volume_dd_blocksize = 1M {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] volume_name_template = volume-%s {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] volume_service_inithost_offload = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] volume_usage_audit_period = month {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] zoning_mode = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_concurrency.disable_process_locking = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.auth_section = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.auth_type = password {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.auth_version = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.cache = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.certfile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.include_service_catalog = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.insecure = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.interface = public {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.keyfile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.memcache_password = {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87570) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 21 18:58:46 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.quobyte [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.quobyte [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.memcache_username = {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.region_name = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.service_type = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.96/identity {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Running cmd (subprocess): mount.quobyte {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.backend = dogpile.cache.null {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.backend_argument = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.backend_expiration_time = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.config_prefix = cache.oslo {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.debug_cache_backend = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.enable_retry_client = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.enable_socket_keepalive = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.enabled = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.expiration_time = 600 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.hashclient_retry_attempts = 2 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.memcache_dead_retry = 300 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.memcache_pool_maxsize = 10 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.memcache_sasl_enabled = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.password = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.proxies = [] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.redis_db = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.redis_server = localhost:6379 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.retry_attempts = 2 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.retry_delay = 0.0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.socket_keepalive_count = 1 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.socket_keepalive_idle = 1 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.socket_keepalive_interval = 1 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.socket_timeout = 1.0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.tls_allowed_ciphers = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.tls_cafile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.tls_certfile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.tls_enabled = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.tls_keyfile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cache.username = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] coordination.backend_url = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.asyncio_connection = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.asyncio_slave_connection = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.backend = sqlalchemy {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.connection = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.connection_debug = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.connection_parameters = {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.connection_recycle_time = 3600 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.connection_trace = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.db_inc_retry_interval = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.db_max_retries = 20 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.db_max_retry_interval = 10 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.db_retry_interval = 1 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.max_overflow = 50 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.max_pool_size = 5 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.max_retries = 10 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.mysql_wsrep_sync_wait = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.pool_timeout = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.retry_interval = 10 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.slave_connection = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.sqlite_synchronous = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.synchronous_reader = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] database.use_db_reconnect = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] profiler.connection_string = messaging:// {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] profiler.enabled = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] profiler.es_doc_type = notification {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] profiler.es_scroll_size = 10000 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] profiler.es_scroll_time = 2m {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] profiler.filter_error_trace = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] profiler.hmac_keys = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] profiler.sentinel_service_name = mymaster {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] profiler.socket_timeout = 0.1 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] profiler.trace_requests = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] profiler.trace_sqlalchemy = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] profiler_jaeger.process_tags = {} {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] profiler_jaeger.service_name_prefix = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] profiler_otlp.service_name_prefix = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_policy.enforce_new_defaults = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_policy.policy_default_rule = default {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_policy.policy_file = policy.yaml {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] privsep_osbrick.group = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] privsep_osbrick.helper_command = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] privsep_osbrick.user = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cinder_sys_admin.group = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cinder_sys_admin.helper_command = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] cinder_sys_admin.user = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] service_user.auth_section = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] service_user.auth_type = password {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] service_user.cafile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] service_user.certfile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] service_user.collect_timing = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] service_user.insecure = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] service_user.keyfile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] service_user.send_service_user_token = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack quobyte-client[87572]: Reading configuration file: /etc/quobyte/client.cfg Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] service_user.split_loggers = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] service_user.timeout = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance.auth_section = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance.auth_type = password {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance.certfile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance.collect_timing = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack quobyte-client[87572]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance.insecure = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance.keyfile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance.region_name = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance.split_loggers = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] glance.timeout = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.backend_availability_zone = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.chap_password = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.chap_username = {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.disk_geometry = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.driver_client_cert = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.driver_client_cert_key = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.driver_data_namespace = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.driver_use_ssl = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.extra_capabilities = {} {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.filter_function = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.goodness_function = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.iscsi_target_flags = {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.iscsi_write_cache = on {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.iser_helper = tgtadm {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 18:58:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.iser_ip_address = 192.168.122.96 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.iser_port = 3260 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.nas_host = {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.nas_login = admin {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.nas_mount_options = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.nas_password = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.nas_private_key = {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.nas_share_path = {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.num_shell_tries = 3 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.quobyte_volume_url = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.replication_device = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.report_discard_supported = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.reserved_percentage = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.target_helper = tgtadm {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.target_ip_address = 192.168.122.96 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.target_port = 3260 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.target_protocol = iscsi {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.trace_flags = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.unique_fqdn_network = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.use_chap_auth = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.volume_backend_name = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.volume_clear = zero {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.volume_clear_ionice = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.volume_clear_size = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_reports.file_event_handler = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_reports.log_dir = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.backend_availability_zone = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.backend_host = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.chap_password = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.chap_username = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.chiscsi_conf = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.disk_geometry = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.driver_client_cert = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.driver_data_namespace = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.driver_use_ssl = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.extra_capabilities = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.filter_function = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.goodness_function = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.iser_helper = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.iser_ip_address = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.iser_port = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.iser_target_prefix = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.nas_host = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.nas_login = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.nas_mount_options = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.nas_password = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.nas_private_key = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.nas_share_path = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.nas_ssh_port = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.num_shell_tries = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.nvmet_port_id = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.replication_device = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.report_discard_supported = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.reserved_percentage = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.scst_target_driver = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.storage_protocol = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.target_helper = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.target_ip_address = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.target_port = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.target_prefix = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.target_protocol = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.trace_flags = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack sudo[87573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.use_chap_auth = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.volume_clear = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.volume_clear_size = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] QuobyteHD.volumes_dir = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.ssl = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_notifications.driver = [] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_notifications.retry = -1 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] key_manager.fixed_key = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican.barbican_api_version = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican.barbican_endpoint = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican.barbican_endpoint_type = public {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican.barbican_region_name = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican.cafile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican.certfile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican.collect_timing = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican.insecure = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican.keyfile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican.number_of_retries = 60 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican.retry_delay = 1 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican.send_service_user_token = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican.split_loggers = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican.timeout = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican.verify_ssl = True {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican.verify_ssl_path = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican_service_user.auth_section = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican_service_user.auth_type = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican_service_user.cafile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican_service_user.certfile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican_service_user.collect_timing = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican_service_user.insecure = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican_service_user.keyfile = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican_service_user.split_loggers = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] barbican_service_user.timeout = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] vault.approle_role_id = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] vault.approle_secret_id = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] vault.auth_method = approle {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] vault.auth_path = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] vault.kv_mountpoint = secret {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] vault.kv_path = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] vault.kv_version = 2 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] vault.namespace = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] vault.root_token_id = **** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] vault.ssl_ca_crt_file = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] vault.timeout = 60.0 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] vault.token_file = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] vault.token_role = None {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] vault.use_ssl = False {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:58:46 devstack cinder-volume[87272]: DEBUG oslo_service.backend._eventlet.service [None req-cdba41e6-1e0e-4c26-8adc-d046befacce0 None None] ******************************************************************************** {{(pid=87272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 18:58:46 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root Jul 21 18:58:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.258s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:58:46 devstack cinder-volume[87570]: INFO cinder.volume.driver [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Driver hasn't implemented _init_vendor_properties() Jul 21 18:58:46 devstack cinder-volume[87570]: DEBUG cinder.volume.driver [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87570) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG oslo_db.sqlalchemy.engines [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87570) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writer thread running {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG cinder.db.api [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Building query based on filter {{(pid=87570) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87570) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:58:47 devstack cinder-volume[87570]: INFO cinder.keymgr.migration [None req-c04bbed2-0c2a-4c03-8aa3-61d3b6f2e57c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 18:58:47 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 18:58:47 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:58:47 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.235s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 18:58:47 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Driver initialization completed successfully. Jul 21 18:58:47 devstack cinder-volume[87570]: INFO cinder.manager [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Initiating service 3 cleanup Jul 21 18:58:47 devstack cinder-volume[87570]: INFO cinder.manager [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Service 3 cleanup completed. Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG cinder.service [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Creating RPC server for service cinder-volume {{(pid=87570) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG cinder.service [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87570) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 18:58:47 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:58:47 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 18:58:47 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:58:47 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Jul 21 18:58:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.236s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:58:47 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c108e464-82d9-4249-8c4d-3c3ebda415e2 None None] Driver post RPC initialization completed successfully. Jul 21 18:58:56 devstack cinder-volume[87272]: DEBUG dbcounter [-] [87272] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:58:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 18:58:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 6 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 18:58:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 18:58:57 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=3 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:58:57 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Flow 'volume_create_manager' (53ab504c-e0a3-4da9-b74b-b84d9fd5c5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88921b59-c56a-4fbe-9661-b3ed1c8f9466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88921b59-c56a-4fbe-9661-b3ed1c8f9466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T16:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1166453816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24db707-b6e1-4493-a03f-835956a7f697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce5bbbc1a9143bf8cb34c56afac3676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T16:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T16:59:46Z,use_quota=True,user_id='2dd3e6bbf82046b289268a87019799e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b00403d-8be7-42a0-80c0-c5bb64d6b840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b00403d-8be7-42a0-80c0-c5bb64d6b840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9400d5b6-aa97-4139-99bd-11fa794bdb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9400d5b6-aa97-4139-99bd-11fa794bdb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f24db707-b6e1-4493-a03f-835956a7f697', 'volume_name': 'volume-f24db707-b6e1-4493-a03f-835956a7f697', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7c4ec6-6d18-4cef-b8d6-bb9238a04927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7c4ec6-6d18-4cef-b8d6-bb9238a04927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e2540bf-555c-46d0-ae1a-2915a477b110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:46 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Volume f24db707-b6e1-4493-a03f-835956a7f697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f24db707-b6e1-4493-a03f-835956a7f697', 'volume_size': 1} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T16:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1166453816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24db707-b6e1-4493-a03f-835956a7f697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce5bbbc1a9143bf8cb34c56afac3676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T16:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T16:59:46Z,use_quota=True,user_id='2dd3e6bbf82046b289268a87019799e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Creating volume f24db707-b6e1-4493-a03f-835956a7f697 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 18:59:46 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f24db707-b6e1-4493-a03f-835956a7f697 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:46 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f24db707-b6e1-4493-a03f-835956a7f697 1073741824 Jul 21 18:59:46 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Flow 'volume_create_manager' (31192cca-d327-4d86-a208-d3cba87928ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0551c7-5111-4a1d-b73f-2264bab5a844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0551c7-5111-4a1d-b73f-2264bab5a844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T16:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1202330114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e90a000-6ab7-4e0e-bcbc-de38db82a0cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e60578efce024436bad255e90d5b1849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T16:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T16:59:46Z,use_quota=True,user_id='cc4af1340a144cc485086b05ed19701b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd163a5b-1a23-4d0e-9f46-6d4653bec352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd163a5b-1a23-4d0e-9f46-6d4653bec352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73a5395-4180-4631-9531-291e5f3ae572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73a5395-4180-4631-9531-291e5f3ae572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e90a000-6ab7-4e0e-bcbc-de38db82a0cc', 'volume_name': 'volume-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0053e2-ee46-4dca-bdbf-0c1d018458da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0053e2-ee46-4dca-bdbf-0c1d018458da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c7eb302-1e53-4c01-a5d5-e801ba29a5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:46 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Volume 4e90a000-6ab7-4e0e-bcbc-de38db82a0cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc', 'volume_size': 1} Jul 21 18:59:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 18:59:47 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f24db707-b6e1-4493-a03f-835956a7f697 1073741824" returned: 0 in 0.660s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f24db707-b6e1-4493-a03f-835956a7f697 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:47 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f24db707-b6e1-4493-a03f-835956a7f697 Jul 21 18:59:47 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:47 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f24db707-b6e1-4493-a03f-835956a7f697" returned: 0 in 0.359s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.887s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T16:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1202330114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e90a000-6ab7-4e0e-bcbc-de38db82a0cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e60578efce024436bad255e90d5b1849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T16:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T16:59:46Z,use_quota=True,user_id='cc4af1340a144cc485086b05ed19701b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Creating volume 4e90a000-6ab7-4e0e-bcbc-de38db82a0cc {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 18:59:47 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e2540bf-555c-46d0-ae1a-2915a477b110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f24db707-b6e1-4493-a03f-835956a7f697', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ca7378-0294-440f-9353-e2b547824466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:47 devstack sudo[88277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc 1073741824 Jul 21 18:59:47 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:47 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Volume volume-f24db707-b6e1-4493-a03f-835956a7f697 (f24db707-b6e1-4493-a03f-835956a7f697): created successfully Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ca7378-0294-440f-9353-e2b547824466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Flow 'volume_create_manager' (53ab504c-e0a3-4da9-b74b-b84d9fd5c5d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 18:59:47 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-56ba8559-b0a6-490f-aba3-897207e7ba75 tempest-TaggedAttachmentsTest-1886546292 None] Created volume successfully. Jul 21 18:59:48 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc 1073741824" returned: 0 in 0.689s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:48 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc Jul 21 18:59:48 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:48 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc" returned: 0 in 0.328s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 18:59:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 18:59:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c7eb302-1e53-4c01-a5d5-e801ba29a5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a6f126-7ebf-47d1-9fdc-c7a67d44b241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:48 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Volume volume-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc (4e90a000-6ab7-4e0e-bcbc-de38db82a0cc): created successfully Jul 21 18:59:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a6f126-7ebf-47d1-9fdc-c7a67d44b241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Flow 'volume_create_manager' (31192cca-d327-4d86-a208-d3cba87928ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 18:59:48 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-8d43afeb-5175-4f55-b851-f6ad3745f659 req-cf6776ca-c3f6-4b24-be20-86f5e8c8966c tempest-VolumesGetTestJSON-428226862 None] Created volume successfully. Jul 21 18:59:50 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Acquiring lock "cinder-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 18:59:50 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Lock "cinder-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 18:59:50 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Acquiring lock "cinder-quobyte-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 18:59:50 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Lock "cinder-quobyte-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc" acquired by "delete_volume" :: waited 0.026s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 18:59:50 devstack cinder-volume[87570]: INFO oslo.privsep.daemon [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp__3qq_ty/privsep.sock'] Jul 21 18:59:50 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp__3qq_ty/privsep.sock Jul 21 18:59:50 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:51 devstack cinder-volume[87570]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 21 18:59:51 devstack cinder-volume[87570]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 18:59:51 devstack cinder-volume[87570]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 21 18:59:51 devstack cinder-volume[87570]: WARNING oslo.privsep.daemon [-] privsep log: Jul 21 18:59:51 devstack cinder-volume[87570]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 21 18:59:51 devstack cinder-volume[87570]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 21 18:59:51 devstack cinder-volume[87570]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 18:59:51 devstack cinder-volume[87570]: WARNING oslo.privsep.daemon [-] privsep log: Jul 21 18:59:51 devstack cinder-volume[87570]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 21 18:59:51 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:51 devstack cinder-volume[87570]: INFO oslo.privsep.daemon [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Spawned new privsep daemon via rootwrap Jul 21 18:59:51 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Accepted privsep connection to /tmp/tmp__3qq_ty/privsep.sock {{(pid=87570) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 21 18:59:51 devstack cinder-volume[87570]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 21 18:59:51 devstack cinder-volume[87570]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 21 18:59:51 devstack cinder-volume[87570]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 21 18:59:51 devstack cinder-volume[87570]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88308 Jul 21 18:59:51 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3931505-93d1-4eda-b3c8-420ff3e1959c]: (2,) {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 18:59:51 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d38953-925c-4c33-a2f9-c5555ff08c27]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 18:59:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:52 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc Jul 21 18:59:52 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:52 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc" returned: 0 in 0.643s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:52 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc Jul 21 18:59:52 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:52 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc" returned: 0 in 0.386s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:52 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Lock "cinder-quobyte-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc" released by "delete_volume" :: held 2.780s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 18:59:53 devstack cinder-volume[87570]: WARNING cinder.quota [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 18:59:53 devstack cinder-volume[87570]: WARNING cinder.quota [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 18:59:53 devstack cinder-volume[87570]: DEBUG cinder.quota [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Created reservations ['5c70ca17-d37b-41c4-8d40-da2356c5e271', '71e8958c-44c6-49c4-b9c5-ab6b9f9b0aba', '3595711b-4c63-4e02-8fe4-3994772a5fae', '3453c265-9a1c-4d21-832c-34682348e7dc'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 18:59:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 18:59:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 18:59:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 18:59:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 18:59:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 18:59:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:53 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 18:59:53 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:53 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.540s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:53 devstack cinder-volume[87570]: DEBUG cinder.manager [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 18:59:53 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Deleted volume successfully. Jul 21 18:59:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-b041a80e-e8c3-409b-b046-35a1468ca76b req-2818c4b8-628a-45e6-9681-5173d6bbe591 tempest-VolumesGetTestJSON-428226862 None] Lock "cinder-4e90a000-6ab7-4e0e-bcbc-de38db82a0cc-delete_volume" released by "delete_volume" :: held 3.994s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 18:59:56 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 18:59:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Flow 'volume_create_manager' (4cdaa6db-45e6-456b-a8b6-a5ad332f3cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 18:59:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1906b46-8bfa-4953-9e0d-76bbd21ab4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 18:59:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 18:59:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 18:59:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 18:59:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 18:59:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 18:59:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:56 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 18:59:56 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1906b46-8bfa-4953-9e0d-76bbd21ab4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T16:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-200538554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53bad11-2bed-4072-b6ec-17f2a9fc4322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae762fc23d1e4863ab1f2b8b3d0eb4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T16:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T16:59:57Z,use_quota=True,user_id='d7b01fad4b4f4646abaf1fbd2ae1693d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee94e202-5431-4216-a50f-d95bdd33d81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee94e202-5431-4216-a50f-d95bdd33d81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ad0ed1-f49f-4396-8385-3d573ed127a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ad0ed1-f49f-4396-8385-3d573ed127a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e53bad11-2bed-4072-b6ec-17f2a9fc4322', 'volume_name': 'volume-e53bad11-2bed-4072-b6ec-17f2a9fc4322', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e965dd18-2b1e-4c86-9164-abba22414ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e965dd18-2b1e-4c86-9164-abba22414ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1523ad4f-9647-4ccc-a4b7-4ce3007c8f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:57 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Volume e53bad11-2bed-4072-b6ec-17f2a9fc4322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e53bad11-2bed-4072-b6ec-17f2a9fc4322', 'volume_size': 1} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T16:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-200538554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53bad11-2bed-4072-b6ec-17f2a9fc4322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae762fc23d1e4863ab1f2b8b3d0eb4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T16:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T16:59:57Z,use_quota=True,user_id='d7b01fad4b4f4646abaf1fbd2ae1693d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Creating volume e53bad11-2bed-4072-b6ec-17f2a9fc4322 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 18:59:57 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e53bad11-2bed-4072-b6ec-17f2a9fc4322 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:57 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e53bad11-2bed-4072-b6ec-17f2a9fc4322 1073741824 Jul 21 18:59:57 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:57 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.715s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 8 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 18:59:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 18:59:58 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e53bad11-2bed-4072-b6ec-17f2a9fc4322 1073741824" returned: 0 in 1.046s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e53bad11-2bed-4072-b6ec-17f2a9fc4322 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:58 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e53bad11-2bed-4072-b6ec-17f2a9fc4322 Jul 21 18:59:58 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:58 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e53bad11-2bed-4072-b6ec-17f2a9fc4322" returned: 0 in 0.410s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 18:59:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 18:59:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1523ad4f-9647-4ccc-a4b7-4ce3007c8f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53bad11-2bed-4072-b6ec-17f2a9fc4322', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb4b09e-c8a6-4f81-a7a1-566e6d72bd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 18:59:58 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Volume volume-e53bad11-2bed-4072-b6ec-17f2a9fc4322 (e53bad11-2bed-4072-b6ec-17f2a9fc4322): created successfully Jul 21 18:59:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb4b09e-c8a6-4f81-a7a1-566e6d72bd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 18:59:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Flow 'volume_create_manager' (4cdaa6db-45e6-456b-a8b6-a5ad332f3cd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 18:59:58 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0194ebb5-be2d-4394-9c95-89b3d81bd67b tempest-VolumesAdminNegativeTest-1831973370 None] Created volume successfully. Jul 21 19:00:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] Acquiring lock "cinder-e53bad11-2bed-4072-b6ec-17f2a9fc4322-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:00:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] Lock "cinder-e53bad11-2bed-4072-b6ec-17f2a9fc4322-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:00:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] Acquiring lock "cinder-quobyte-e53bad11-2bed-4072-b6ec-17f2a9fc4322" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:00:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] Lock "cinder-quobyte-e53bad11-2bed-4072-b6ec-17f2a9fc4322" acquired by "delete_volume" :: waited 0.063s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:00:01 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7f4583-ff86-4f30-ae63-38cc08db6c3e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:00:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e53bad11-2bed-4072-b6ec-17f2a9fc4322 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:01 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e53bad11-2bed-4072-b6ec-17f2a9fc4322 Jul 21 19:00:01 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:02 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e53bad11-2bed-4072-b6ec-17f2a9fc4322" returned: 0 in 0.609s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e53bad11-2bed-4072-b6ec-17f2a9fc4322 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:02 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e53bad11-2bed-4072-b6ec-17f2a9fc4322 Jul 21 19:00:02 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:02 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e53bad11-2bed-4072-b6ec-17f2a9fc4322" returned: 0 in 0.408s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] Lock "cinder-quobyte-e53bad11-2bed-4072-b6ec-17f2a9fc4322" released by "delete_volume" :: held 1.102s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:00:02 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] Created reservations ['28df5ffb-5e58-41e7-92e1-c18da1f1e226', '6e12576c-117f-4cc4-a207-6c4b8e95fd29', '56651e2b-b1f7-4206-af5c-2f5642816326', '9b8895df-ae1d-4ae8-8e86-37c78c4ac008'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:00:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-898bfcbb-2244-4c29-a70f-29efe0b48fce tempest-BackendsCapabilitiesAdminTestsJSON-1695760575 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87570) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 19:00:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-59aa456e-a9fe-4be0-b504-999cdfc533f9 tempest-BackendsCapabilitiesAdminTestsJSON-1695760575 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87570) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 19:00:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:00:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:00:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:03 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:00:03 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:03 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.336s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:03 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:00:03 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] Deleted volume successfully. Jul 21 19:00:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e3a7e244-643f-455e-a6c4-0a947b7ba72d tempest-VolumesAdminNegativeTest-1831973370 None] Lock "cinder-e53bad11-2bed-4072-b6ec-17f2a9fc4322-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:00:13 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=24,cinder:SELECT=18,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:00:13 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=14,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:00:14 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-21910f98-c49d-4c4f-80ed-960fdae95d89 tempest-GroupSnapshotsTest-2076344213 None] Group tempest-GroupSnapshotsTest-Group-67523958: creating Jul 21 19:00:14 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-21910f98-c49d-4c4f-80ed-960fdae95d89 tempest-GroupSnapshotsTest-2076344213 None] Group tempest-GroupSnapshotsTest-Group-67523958: created successfully Jul 21 19:00:14 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-21910f98-c49d-4c4f-80ed-960fdae95d89 tempest-GroupSnapshotsTest-2076344213 None] Create group completed successfully. Jul 21 19:00:16 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:00:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Flow 'volume_create_manager' (e9ee5be6-178a-46aa-bcd3-59f168d397c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:00:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402709d5-2a34-4dec-8af5-ead083c843d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402709d5-2a34-4dec-8af5-ead083c843d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1809909819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=40eb4edb-49aa-4cea-bce7-d7ca5fcfdef4,host='devstack@QuobyteHD#QuobyteHD',id=2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb1c0e3808a4f0b8057aee37e523998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:00:17Z,use_quota=True,user_id='dfca8b3d26ef4f2ea8ee14f560b85c3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6def3df4-2305-4799-a6cb-5dc5de84c986),volume_type_id=6def3df4-2305-4799-a6cb-5dc5de84c986)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55de1e2-f57a-4099-b668-28ba3035a9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55de1e2-f57a-4099-b668-28ba3035a9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec79b37-1c99-49b6-893d-5cd5a9477cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec79b37-1c99-49b6-893d-5cd5a9477cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1', 'volume_name': 'volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbbb6fb-35be-4e98-ae48-ef3f02eba3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbbb6fb-35be-4e98-ae48-ef3f02eba3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37169fad-24eb-4858-bcab-e70b2adecaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:17 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Volume 2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1', 'volume_size': 1} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=40eb4edb-49aa-4cea-bce7-d7ca5fcfdef4,created_at=2026-07-21T17:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1809909819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=40eb4edb-49aa-4cea-bce7-d7ca5fcfdef4,host='devstack@QuobyteHD#QuobyteHD',id=2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb1c0e3808a4f0b8057aee37e523998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:00:17Z,use_quota=True,user_id='dfca8b3d26ef4f2ea8ee14f560b85c3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6def3df4-2305-4799-a6cb-5dc5de84c986),volume_type_id=6def3df4-2305-4799-a6cb-5dc5de84c986)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Creating volume 2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:00:17 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:17 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 1073741824 Jul 21 19:00:17 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:17 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 1073741824" returned: 0 in 0.756s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:17 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 Jul 21 19:00:17 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:18 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1" returned: 0 in 0.406s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:00:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37169fad-24eb-4858-bcab-e70b2adecaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397e691a-cf9a-47d8-9c75-402656db1648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:18 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Volume volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 (2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1): created successfully Jul 21 19:00:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397e691a-cf9a-47d8-9c75-402656db1648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Flow 'volume_create_manager' (e9ee5be6-178a-46aa-bcd3-59f168d397c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:00:18 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-810e1f09-9dfb-4b05-a35c-b72ceee760d2 tempest-GroupSnapshotsTest-2076344213 None] Created volume successfully. Jul 21 19:00:20 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] GroupSnapshot e59ae02e-1b10-4328-8925-31159c622c49: creating. Jul 21 19:00:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] Group snapshot e59ae02e-1b10-4328-8925-31159c622c49: creating. {{(pid=87570) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 19:00:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] Creating offline snapshot 7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 of volume 2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:00:20 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f31dd6e-c15c-4d16-ab98-8af44743c96e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:00:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:20 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 Jul 21 19:00:20 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:20 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1" returned: 0 in 0.487s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:20 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 1G Jul 21 19:00:20 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:21 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 1G" returned: 0 in 0.700s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:21 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 Jul 21 19:00:21 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:21 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2" returned: 0 in 0.359s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:21 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:00:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:21 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 Jul 21 19:00:21 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:22 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2" returned: 0 in 0.274s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:22 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.info Jul 21 19:00:22 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:22 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.info" returned: 0 in 0.572s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:22 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:00:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:22 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.info Jul 21 19:00:22 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:23 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.info" returned: 0 in 0.285s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.828s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:23 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f2f5c765-ad27-4975-ba2e-794ab5c431fa tempest-GroupSnapshotsTest-2076344213 None] group_snapshot e59ae02e-1b10-4328-8925-31159c622c49: created successfully Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "cinder-quobyte-7b404a5c-385d-4277-8aa4-9cfe2c57d1f2-10cac080-1093-433d-8841-cd9400d47c9b" by "_create_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-7b404a5c-385d-4277-8aa4-9cfe2c57d1f2-10cac080-1093-433d-8841-cd9400d47c9b" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Creating volume 10cac080-1093-433d-8841-cd9400d47c9b from snapshot 7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 {{(pid=87570) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "cinder-quobyte-10cac080-1093-433d-8841-cd9400d47c9b" by "_copy_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-10cac080-1093-433d-8841-cd9400d47c9b" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] snapshot: 7b404a5c-385d-4277-8aa4-9cfe2c57d1f2, volume: 10cac080-1093-433d-8841-cd9400d47c9b, {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2159909-e39f-4f2b-b383-89d4605d2b22]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:00:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:25 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 Jul 21 19:00:25 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:25 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2" returned: 0 in 0.448s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:00:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:00:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Creating direct copy from snapshot {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:00:25 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b1e6ad-784a-4387-a8e5-6bf33d361a79]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:00:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:25 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 Jul 21 19:00:25 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:25 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1" returned: 0 in 0.462s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:25 devstack cinder-volume[87570]: DEBUG cinder.utils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Path /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-10cac080-1093-433d-8841-cd9400d47c9b not found in is_blk_device check {{(pid=87570) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:00:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-10cac080-1093-433d-8841-cd9400d47c9b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:25 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-10cac080-1093-433d-8841-cd9400d47c9b Jul 21 19:00:25 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:32 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-10cac080-1093-433d-8841-cd9400d47c9b" returned: 0 in 6.239s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:32 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[f176ae95-4078-477b-bc8e-b1b6f68c9df0]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:00:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:32 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 Jul 21 19:00:32 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:32 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1" returned: 0 in 0.732s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:32 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Image conversion details: src /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-10cac080-1093-433d-8841-cd9400d47c9b {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:00:32 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Converted 1024.00 MB image at 164.10 MB/s Jul 21 19:00:32 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-10cac080-1093-433d-8841-cd9400d47c9b is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:00:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-10cac080-1093-433d-8841-cd9400d47c9b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:32 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-10cac080-1093-433d-8841-cd9400d47c9b Jul 21 19:00:32 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:33 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-10cac080-1093-433d-8841-cd9400d47c9b" returned: 0 in 0.327s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-10cac080-1093-433d-8841-cd9400d47c9b" released by "_copy_volume_from_snapshot" :: held 8.355s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:00:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-7b404a5c-385d-4277-8aa4-9cfe2c57d1f2-10cac080-1093-433d-8841-cd9400d47c9b" released by "_create_volume_from_snapshot" :: held 8.399s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:00:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.422s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:33 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-d09dbec1-a8cd-40eb-bb64-9932d105113b tempest-GroupSnapshotsTest-2076344213 None] Create group from source-snapshot-e59ae02e-1b10-4328-8925-31159c622c49 completed successfully. Jul 21 19:00:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "cinder-quobyte-10cac080-1093-433d-8841-cd9400d47c9b" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:00:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-10cac080-1093-433d-8841-cd9400d47c9b" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:00:34 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[344c157b-d085-402c-8195-989c36550241]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:00:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-10cac080-1093-433d-8841-cd9400d47c9b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:34 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-10cac080-1093-433d-8841-cd9400d47c9b Jul 21 19:00:34 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:34 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-10cac080-1093-433d-8841-cd9400d47c9b" returned: 0 in 0.438s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-10cac080-1093-433d-8841-cd9400d47c9b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:34 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-10cac080-1093-433d-8841-cd9400d47c9b Jul 21 19:00:34 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:35 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-10cac080-1093-433d-8841-cd9400d47c9b" returned: 0 in 0.313s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-10cac080-1093-433d-8841-cd9400d47c9b" released by "delete_volume" :: held 0.840s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] Created reservations ['384bf867-670d-4388-9512-0765e65e6b5a'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:00:35 devstack cinder-volume[87570]: WARNING cinder.quota [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2079798157 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2079798157, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:00:35 devstack cinder-volume[87570]: WARNING cinder.quota [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2079798157 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2079798157, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] Created reservations ['15c5a6fa-96f7-456c-a090-d4cab6f24450', '1edd091c-3643-4758-a817-97ceed60e4d2', 'e6f00cda-e2af-424a-a19b-2c936f39c446', 'a7cec150-992a-46a3-a634-2a0a979edad8'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:35 devstack sudo[88806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:00:35 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:35 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] group_snapshot e59ae02e-1b10-4328-8925-31159c622c49: deleting Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] group_snapshot e59ae02e-1b10-4328-8925-31159c622c49: deleting {{(pid=87570) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "cinder-quobyte-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "cinder-quobyte-7b404a5c-385d-4277-8aa4-9cfe2c57d1f2" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-7b404a5c-385d-4277-8aa4-9cfe2c57d1f2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] Deleting offline snapshot 7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 of volume 2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] snapshot_file for this snap is: volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f4894a-a165-418e-95c1-dd6171709c96]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:00:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:36 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.584s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:36 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:00:36 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-a0c2458f-2c0d-4ef3-9e6e-5e54a78ad09c tempest-GroupSnapshotsTest-2076344213 None] Delete group completed successfully. Jul 21 19:00:36 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 Jul 21 19:00:36 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:36 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2" returned: 0 in 0.744s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:00:36 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e67029-cfb9-410c-98b1-7c2437e9f5dd]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:00:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:36 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 Jul 21 19:00:36 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:37 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1" returned: 0 in 0.512s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:37 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 Jul 21 19:00:37 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:37 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2" returned: 0 in 0.376s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:37 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2 Jul 21 19:00:37 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:37 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1.7b404a5c-385d-4277-8aa4-9cfe2c57d1f2" returned: 0 in 0.255s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-7b404a5c-385d-4277-8aa4-9cfe2c57d1f2" released by "_delete_snapshot" :: held 2.025s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:00:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1" released by "delete_snapshot" :: held 2.055s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:00:37 devstack cinder-volume[87570]: WARNING cinder.quota [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2079798157 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2079798157, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:00:38 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] Created reservations ['7cd23690-f42e-4a67-80b2-6cc12a1afa11', '06ac5821-678e-4562-9d44-7fbdd1161932', '1f04c930-86b6-4ed6-92b3-44f35f67c906', '19c51524-992a-4193-82b4-522b0a2cc250'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:00:38 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-2482da51-4200-4dbb-8ef3-fc427055b3ae tempest-GroupSnapshotsTest-2076344213 None] group_snapshot e59ae02e-1b10-4328-8925-31159c622c49: deleted successfully Jul 21 19:00:38 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "cinder-quobyte-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:00:38 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1" acquired by "delete_volume" :: waited 0.028s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:00:38 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fc9da1-e422-49ae-bffd-69559d5ebdc4]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:00:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:38 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 Jul 21 19:00:38 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:39 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1" returned: 0 in 0.418s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:39 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1 Jul 21 19:00:39 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:39 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1" returned: 0 in 0.288s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-2bc3fbb1-d7b0-493b-a010-3dc0a9056cd1" released by "delete_volume" :: held 0.817s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:00:39 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] Created reservations ['a57f3e60-6032-4cce-b2c8-91959530102c'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:00:39 devstack cinder-volume[87570]: WARNING cinder.db.api [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2079798157'] Jul 21 19:00:39 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] Created reservations ['fbfeed2f-12c5-4a37-870b-5d37134976cc', '1abad402-4561-4bce-af63-3bfb23b02951', 'c424b1a9-15a8-47d6-9ff4-265c6a8a7bf1', '93dc4923-e987-45ea-b2c2-e254bd2dace3'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:00:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:00:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:00:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:39 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:00:39 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:40 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.291s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:40 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:00:40 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-756cbc91-561e-45a4-88f4-7c9c22548301 tempest-GroupSnapshotsTest-2076344213 None] Delete group completed successfully. Jul 21 19:00:40 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f505dd80-6daa-4cc1-a5e2-466b2216cc95 tempest-GroupSnapshotsTest-2076344213 None] Group tempest-GroupSnapshotsTest-Group-934539692: creating Jul 21 19:00:40 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f505dd80-6daa-4cc1-a5e2-466b2216cc95 tempest-GroupSnapshotsTest-2076344213 None] Group tempest-GroupSnapshotsTest-Group-934539692: created successfully Jul 21 19:00:40 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f505dd80-6daa-4cc1-a5e2-466b2216cc95 tempest-GroupSnapshotsTest-2076344213 None] Create group completed successfully. Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Flow 'volume_create_manager' (44c790b5-3261-4403-a82a-ded3418639c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96622d6c-a8a1-4fa8-a3a9-cdd3664ebbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96622d6c-a8a1-4fa8-a3a9-cdd3664ebbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1980464870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf47dc20-7d50-42e1-b9d5-6f5bfee0be18,host='devstack@QuobyteHD#QuobyteHD',id=31e9024e-21fb-4d62-95e3-21a7cd66c9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb1c0e3808a4f0b8057aee37e523998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:00:42Z,use_quota=True,user_id='dfca8b3d26ef4f2ea8ee14f560b85c3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8f42a1d-9cd0-4c43-b4c9-80e1dc36264f),volume_type_id=c8f42a1d-9cd0-4c43-b4c9-80e1dc36264f)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56231aca-f31f-4eaa-bd36-cf412b8ee8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56231aca-f31f-4eaa-bd36-cf412b8ee8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eee4e1b-0bea-41e1-ad17-b9957f115f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eee4e1b-0bea-41e1-ad17-b9957f115f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31e9024e-21fb-4d62-95e3-21a7cd66c9be', 'volume_name': 'volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67cb7ca-5c51-4f27-a978-362a7a6c9aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67cb7ca-5c51-4f27-a978-362a7a6c9aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b53789-b47d-4ef8-9c3a-a1926713c9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:42 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Volume 31e9024e-21fb-4d62-95e3-21a7cd66c9be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be', 'volume_size': 1} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bf47dc20-7d50-42e1-b9d5-6f5bfee0be18,created_at=2026-07-21T17:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1980464870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf47dc20-7d50-42e1-b9d5-6f5bfee0be18,host='devstack@QuobyteHD#QuobyteHD',id=31e9024e-21fb-4d62-95e3-21a7cd66c9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb1c0e3808a4f0b8057aee37e523998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:00:42Z,use_quota=True,user_id='dfca8b3d26ef4f2ea8ee14f560b85c3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8f42a1d-9cd0-4c43-b4c9-80e1dc36264f),volume_type_id=c8f42a1d-9cd0-4c43-b4c9-80e1dc36264f)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Creating volume 31e9024e-21fb-4d62-95e3-21a7cd66c9be {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:00:42 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:00:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:42 devstack sudo[88853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be 1073741824 Jul 21 19:00:42 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:43 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be 1073741824" returned: 0 in 0.603s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:43 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be Jul 21 19:00:43 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:43 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be" returned: 0 in 0.643s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:43 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:00:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b53789-b47d-4ef8-9c3a-a1926713c9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83685059-5693-41eb-954b-34e3322402e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:44 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Volume volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be (31e9024e-21fb-4d62-95e3-21a7cd66c9be): created successfully Jul 21 19:00:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83685059-5693-41eb-954b-34e3322402e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Flow 'volume_create_manager' (44c790b5-3261-4403-a82a-ded3418639c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:00:44 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4baf3981-2673-4d1d-a781-5edce8785eed tempest-GroupSnapshotsTest-2076344213 None] Created volume successfully. Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Flow 'volume_create_manager' (9adf6d84-1871-4f50-bda5-e7585491038e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ca1a46-d4c3-40bf-9478-824db8876664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ca1a46-d4c3-40bf-9478-824db8876664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-780440286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf47dc20-7d50-42e1-b9d5-6f5bfee0be18,host='devstack@QuobyteHD#QuobyteHD',id=748d0363-b976-48f4-9621-f73b195bebb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb1c0e3808a4f0b8057aee37e523998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:00:46Z,use_quota=True,user_id='dfca8b3d26ef4f2ea8ee14f560b85c3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8f42a1d-9cd0-4c43-b4c9-80e1dc36264f),volume_type_id=c8f42a1d-9cd0-4c43-b4c9-80e1dc36264f)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98156dd-9a2f-48b2-98c0-e8fa9c88a6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98156dd-9a2f-48b2-98c0-e8fa9c88a6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6df4035-c48c-4a3a-8b82-d96e0f835eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6df4035-c48c-4a3a-8b82-d96e0f835eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '748d0363-b976-48f4-9621-f73b195bebb5', 'volume_name': 'volume-748d0363-b976-48f4-9621-f73b195bebb5', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c386b0a3-5be8-42c2-b3d7-da89a3a12874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c386b0a3-5be8-42c2-b3d7-da89a3a12874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eaf7219-f98a-4352-825d-db6a9c874ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:46 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Volume 748d0363-b976-48f4-9621-f73b195bebb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-748d0363-b976-48f4-9621-f73b195bebb5', 'volume_size': 1} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bf47dc20-7d50-42e1-b9d5-6f5bfee0be18,created_at=2026-07-21T17:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-780440286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf47dc20-7d50-42e1-b9d5-6f5bfee0be18,host='devstack@QuobyteHD#QuobyteHD',id=748d0363-b976-48f4-9621-f73b195bebb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb1c0e3808a4f0b8057aee37e523998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:00:46Z,use_quota=True,user_id='dfca8b3d26ef4f2ea8ee14f560b85c3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8f42a1d-9cd0-4c43-b4c9-80e1dc36264f),volume_type_id=c8f42a1d-9cd0-4c43-b4c9-80e1dc36264f)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Creating volume 748d0363-b976-48f4-9621-f73b195bebb5 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:00:46 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:00:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:46 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5 1073741824 Jul 21 19:00:46 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:47 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5 1073741824" returned: 0 in 0.839s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:47 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5 Jul 21 19:00:47 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:47 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5" returned: 0 in 0.451s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:00:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eaf7219-f98a-4352-825d-db6a9c874ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-748d0363-b976-48f4-9621-f73b195bebb5', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61620ee5-29bd-43ec-bb69-c0939f3b79fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:00:47 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Volume volume-748d0363-b976-48f4-9621-f73b195bebb5 (748d0363-b976-48f4-9621-f73b195bebb5): created successfully Jul 21 19:00:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61620ee5-29bd-43ec-bb69-c0939f3b79fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:00:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Flow 'volume_create_manager' (9adf6d84-1871-4f50-bda5-e7585491038e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:00:48 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-7fc217b9-e097-4189-97b4-fc722b1c21d1 tempest-GroupSnapshotsTest-2076344213 None] Created volume successfully. Jul 21 19:00:49 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-83ff670c-791c-4075-a88a-5e006ad7f6fd tempest-GroupSnapshotsTest-2076344213 None] Update group completed successfully. Jul 21 19:00:49 devstack cinder-volume[87570]: WARNING py.warnings [req-13f945cd-6935-4af4-af09-4e71c6b3237f req-288a685c-375a-422b-bc24-13e2f86e3d83 tempest-TaggedAttachmentsTest-1886546292 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 21 19:00:49 devstack cinder-volume[87570]: .first() Jul 21 19:00:49 devstack cinder-volume[87570]: Jul 21 19:00:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-13f945cd-6935-4af4-af09-4e71c6b3237f req-288a685c-375a-422b-bc24-13e2f86e3d83 tempest-TaggedAttachmentsTest-1886546292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-13f945cd-6935-4af4-af09-4e71c6b3237f req-288a685c-375a-422b-bc24-13e2f86e3d83 tempest-TaggedAttachmentsTest-1886546292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-13f945cd-6935-4af4-af09-4e71c6b3237f req-288a685c-375a-422b-bc24-13e2f86e3d83 tempest-TaggedAttachmentsTest-1886546292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-13f945cd-6935-4af4-af09-4e71c6b3237f req-288a685c-375a-422b-bc24-13e2f86e3d83 tempest-TaggedAttachmentsTest-1886546292 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-f24db707-b6e1-4493-a03f-835956a7f697', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8d4a06e-795f-48a9-a06d-79e5d657f5f9', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:00:49 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-13f945cd-6935-4af4-af09-4e71c6b3237f req-288a685c-375a-422b-bc24-13e2f86e3d83 tempest-TaggedAttachmentsTest-1886546292 None] attachment_update completed successfully. Jul 21 19:00:50 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-9f6383ca-0a92-46f7-9612-bc0e4e2d7d77 tempest-GroupSnapshotsTest-2076344213 None] Update group completed successfully. Jul 21 19:00:52 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-2d61fc72-4095-4c6a-9d8d-ee11c4ad9403 tempest-GroupSnapshotsTest-2076344213 None] Update group completed successfully. Jul 21 19:00:53 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-9e319dd5-2a78-49ff-95eb-30c882d614e3 tempest-GroupSnapshotsTest-2076344213 None] Update group completed successfully. Jul 21 19:00:55 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-33bb82d8-9d58-4a9a-9f31-a963a2bf6611 req-5376dc0b-ff43-4de0-a26f-61dd79b7e3aa tempest-TaggedAttachmentsTest-1886546292 None] Terminate volume connection completed successfully. Jul 21 19:00:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-33bb82d8-9d58-4a9a-9f31-a963a2bf6611 req-5376dc0b-ff43-4de0-a26f-61dd79b7e3aa tempest-TaggedAttachmentsTest-1886546292 None] Deleting attachment d8d4a06e-795f-48a9-a06d-79e5d657f5f9. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:00:55 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] GroupSnapshot b1792a0b-6898-42ee-908c-754c8701caf0: creating. Jul 21 19:00:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Group snapshot b1792a0b-6898-42ee-908c-754c8701caf0: creating. {{(pid=87570) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 19:00:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Creating offline snapshot 2a748b3a-c394-48d5-839e-92aeb4d41959 of volume 31e9024e-21fb-4d62-95e3-21a7cd66c9be {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:00:55 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2c9897-d594-4776-ad6a-3c0f2019c293]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:00:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:56 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be Jul 21 19:00:56 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:56 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be" returned: 0 in 0.598s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:56 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959 1G Jul 21 19:00:56 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:00:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:00:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:00:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:56 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:00:57 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:57 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.826s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:00:57 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959 1G" returned: 0 in 1.210s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:57 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959 Jul 21 19:00:57 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:58 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959" returned: 0 in 0.537s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:58 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:00:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:58 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959 Jul 21 19:00:58 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:58 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959" returned: 0 in 0.415s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:58 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.info Jul 21 19:00:58 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:59 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.info" returned: 0 in 0.514s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:59 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:00:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:59 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.info Jul 21 19:00:59 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:59 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.info" returned: 0 in 0.373s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.895s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:00:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:00:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:00:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Creating offline snapshot 96d51418-4010-47e4-9ad7-7b88b256b03c of volume 748d0363-b976-48f4-9621-f73b195bebb5 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:00:59 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a72c9a9-33d0-443c-a62b-481dec71b68c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:00:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:59 devstack sudo[89549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5 Jul 21 19:00:59 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:00 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5" returned: 0 in 0.689s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:00 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c 1G Jul 21 19:01:00 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:01 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c 1G" returned: 0 in 0.776s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-748d0363-b976-48f4-9621-f73b195bebb5 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:01 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-748d0363-b976-48f4-9621-f73b195bebb5 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c Jul 21 19:01:01 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:02 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-748d0363-b976-48f4-9621-f73b195bebb5 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c" returned: 0 in 0.848s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:02 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:01:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:02 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c Jul 21 19:01:02 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:02 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c" returned: 0 in 0.640s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:02 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.info Jul 21 19:01:02 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:03 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.info" returned: 0 in 0.613s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:03 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:01:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:03 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.info Jul 21 19:01:03 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:04 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.info" returned: 0 in 0.666s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.454s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:04 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-b447e900-d785-448a-89c5-f8f129256621 tempest-GroupSnapshotsTest-2076344213 None] group_snapshot b1792a0b-6898-42ee-908c-754c8701caf0: created successfully Jul 21 19:01:04 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] group_snapshot b1792a0b-6898-42ee-908c-754c8701caf0: deleting Jul 21 19:01:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] group_snapshot b1792a0b-6898-42ee-908c-754c8701caf0: deleting {{(pid=87570) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 19:01:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "cinder-quobyte-31e9024e-21fb-4d62-95e3-21a7cd66c9be" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-31e9024e-21fb-4d62-95e3-21a7cd66c9be" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "cinder-quobyte-2a748b3a-c394-48d5-839e-92aeb4d41959" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-2a748b3a-c394-48d5-839e-92aeb4d41959" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Deleting offline snapshot 2a748b3a-c394-48d5-839e-92aeb4d41959 of volume 31e9024e-21fb-4d62-95e3-21a7cd66c9be {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:01:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] snapshot_file for this snap is: volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:01:05 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de0b56f-a4f7-49c2-a74d-36b579b083c7]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:05 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959 Jul 21 19:01:05 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:05 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959" returned: 0 in 0.713s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:01:05 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3939467-cd31-44e9-8b9a-efb7fa205fef]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:06 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be Jul 21 19:01:06 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:06 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be" returned: 0 in 1.003s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:07 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959 Jul 21 19:01:07 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Flow 'volume_create_manager' (94dc8467-bdb8-4ad2-857c-02f6b07b957a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef16bcf4-839b-4133-a339-6cab01af6d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef16bcf4-839b-4133-a339-6cab01af6d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2080579611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390bbc10-6bc3-4042-875f-bbfc009771fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c7e0476a24498dbddf1f7040862f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:01:07Z,use_quota=True,user_id='2c4e5ec7607d43a3b3098e9e1268bdf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03758243-f15f-4f0a-9ec0-4ef007b75a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:07 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03758243-f15f-4f0a-9ec0-4ef007b75a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ff2bc3-342d-483f-9555-a40c8682807d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ff2bc3-342d-483f-9555-a40c8682807d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '390bbc10-6bc3-4042-875f-bbfc009771fb', 'volume_name': 'volume-390bbc10-6bc3-4042-875f-bbfc009771fb', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bab25d8-1b8b-4b52-8708-7e2b92aeb5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bab25d8-1b8b-4b52-8708-7e2b92aeb5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f595e0b3-3ddd-4617-8269-8295bd376a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:07 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Volume 390bbc10-6bc3-4042-875f-bbfc009771fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-390bbc10-6bc3-4042-875f-bbfc009771fb', 'volume_size': 1} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2080579611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390bbc10-6bc3-4042-875f-bbfc009771fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c7e0476a24498dbddf1f7040862f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:01:07Z,use_quota=True,user_id='2c4e5ec7607d43a3b3098e9e1268bdf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Creating volume 390bbc10-6bc3-4042-875f-bbfc009771fb {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:01:07 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-390bbc10-6bc3-4042-875f-bbfc009771fb 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959" returned: 0 in 0.659s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:07 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-390bbc10-6bc3-4042-875f-bbfc009771fb 1073741824 Jul 21 19:01:07 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:07 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959 Jul 21 19:01:07 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:07 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be.2a748b3a-c394-48d5-839e-92aeb4d41959" returned: 0 in 0.342s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-2a748b3a-c394-48d5-839e-92aeb4d41959" released by "_delete_snapshot" :: held 2.934s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-31e9024e-21fb-4d62-95e3-21a7cd66c9be" released by "delete_snapshot" :: held 2.971s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "cinder-quobyte-748d0363-b976-48f4-9621-f73b195bebb5" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-748d0363-b976-48f4-9621-f73b195bebb5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "cinder-quobyte-96d51418-4010-47e4-9ad7-7b88b256b03c" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-96d51418-4010-47e4-9ad7-7b88b256b03c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Deleting offline snapshot 96d51418-4010-47e4-9ad7-7b88b256b03c of volume 748d0363-b976-48f4-9621-f73b195bebb5 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] snapshot_file for this snap is: volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b2eb3c-730b-4c18-aa13-d02b9e50b8f5]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:08 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-390bbc10-6bc3-4042-875f-bbfc009771fb 1073741824" returned: 0 in 0.612s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-390bbc10-6bc3-4042-875f-bbfc009771fb {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:08 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-390bbc10-6bc3-4042-875f-bbfc009771fb Jul 21 19:01:08 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:08 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c Jul 21 19:01:08 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:08 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-390bbc10-6bc3-4042-875f-bbfc009771fb" returned: 0 in 0.278s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f595e0b3-3ddd-4617-8269-8295bd376a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-390bbc10-6bc3-4042-875f-bbfc009771fb', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371283d8-89c5-4953-9e54-ba90369b544f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:08 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Volume volume-390bbc10-6bc3-4042-875f-bbfc009771fb (390bbc10-6bc3-4042-875f-bbfc009771fb): created successfully Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371283d8-89c5-4953-9e54-ba90369b544f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Flow 'volume_create_manager' (94dc8467-bdb8-4ad2-857c-02f6b07b957a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:01:08 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-52a5a82b-8bed-48c3-b6fa-f5c5317d0b47 tempest-DeleteServersTestJSON-543547252 None] Created volume successfully. Jul 21 19:01:08 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c" returned: 0 in 0.516s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-748d0363-b976-48f4-9621-f73b195bebb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c5f934-937a-4f99-a8b6-c8180559d840]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:08 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5 Jul 21 19:01:08 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:09 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5" returned: 0 in 0.450s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:09 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c Jul 21 19:01:09 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:09 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c" returned: 0 in 0.451s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:09 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c Jul 21 19:01:09 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:10 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5.96d51418-4010-47e4-9ad7-7b88b256b03c" returned: 0 in 0.464s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-96d51418-4010-47e4-9ad7-7b88b256b03c" released by "_delete_snapshot" :: held 2.076s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:01:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-748d0363-b976-48f4-9621-f73b195bebb5" released by "delete_snapshot" :: held 2.114s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:01:10 devstack cinder-volume[87570]: WARNING cinder.quota [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-881180914 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-881180914, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:01:10 devstack cinder-volume[87570]: WARNING cinder.quota [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-881180914 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-881180914, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:01:10 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Created reservations ['72101e58-8adf-42be-a869-b7d937891e65', '523bcaa1-ad84-46e5-91c5-2774fc9e6f2f', '17f45c33-80ae-4e6f-848d-ed4bfc6f7144', 'ddfa240a-ca97-425a-903e-acf48d0e9c76'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:01:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] Acquiring lock "cinder-f24db707-b6e1-4493-a03f-835956a7f697-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] Lock "cinder-f24db707-b6e1-4493-a03f-835956a7f697-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] Acquiring lock "cinder-quobyte-f24db707-b6e1-4493-a03f-835956a7f697" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:10 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] Created reservations ['72bf5adc-8dcf-4d76-aa13-bfc84b749d03', '582e75e5-00d1-4b20-8b5b-de1577d5b930', '3f0b3daa-eb0c-4567-acff-a73369f397e9', 'f1a1fa01-bf84-4397-a28e-6ec6a1ef08df'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:01:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] Lock "cinder-quobyte-f24db707-b6e1-4493-a03f-835956a7f697" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:10 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[336a7a1d-ddf0-42b7-b9e3-207682560dc2]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f24db707-b6e1-4493-a03f-835956a7f697 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:10 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-32680340-bf2d-458c-b1b7-b7669233452b tempest-GroupSnapshotsTest-2076344213 None] group_snapshot b1792a0b-6898-42ee-908c-754c8701caf0: deleted successfully Jul 21 19:01:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-f6e61b27-1bef-4093-86a4-bb24660d663f req-92e5c649-79f5-4f26-81f8-83ec6cb801ef tempest-DeleteServersTestJSON-543547252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-f6e61b27-1bef-4093-86a4-bb24660d663f req-92e5c649-79f5-4f26-81f8-83ec6cb801ef tempest-DeleteServersTestJSON-543547252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-f6e61b27-1bef-4093-86a4-bb24660d663f req-92e5c649-79f5-4f26-81f8-83ec6cb801ef tempest-DeleteServersTestJSON-543547252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-f6e61b27-1bef-4093-86a4-bb24660d663f req-92e5c649-79f5-4f26-81f8-83ec6cb801ef tempest-DeleteServersTestJSON-543547252 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-390bbc10-6bc3-4042-875f-bbfc009771fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a7bc2d6-9b14-4ff9-9f54-a2f5fef2a3f4', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:01:10 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f24db707-b6e1-4493-a03f-835956a7f697 Jul 21 19:01:10 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:10 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-f6e61b27-1bef-4093-86a4-bb24660d663f req-92e5c649-79f5-4f26-81f8-83ec6cb801ef tempest-DeleteServersTestJSON-543547252 None] attachment_update completed successfully. Jul 21 19:01:11 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f24db707-b6e1-4493-a03f-835956a7f697" returned: 0 in 0.530s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f24db707-b6e1-4493-a03f-835956a7f697 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:11 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f24db707-b6e1-4493-a03f-835956a7f697 Jul 21 19:01:11 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:11 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f24db707-b6e1-4493-a03f-835956a7f697" returned: 0 in 0.298s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] Lock "cinder-quobyte-f24db707-b6e1-4493-a03f-835956a7f697" released by "delete_volume" :: held 0.887s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:01:11 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] Created reservations ['b83da760-835c-4678-872c-571d2287cbb6', '79cc0f5f-4154-45f1-97ec-79a88d1df6df', '0c9adedc-6134-4bfc-89f3-1286b2d6b8d5', 'e9bc4a4b-c90a-4f13-bdfe-6b519d0878a4'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:01:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "cinder-quobyte-31e9024e-21fb-4d62-95e3-21a7cd66c9be" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-31e9024e-21fb-4d62-95e3-21a7cd66c9be" acquired by "delete_volume" :: waited 0.051s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:11 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dff0675-b18a-4198-8da8-441a03bc6b8f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:01:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:01:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:11 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:01:11 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:12 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be Jul 21 19:01:12 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:12 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.323s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:12 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:01:12 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] Deleted volume successfully. Jul 21 19:01:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-08c51603-4414-4c10-8a41-2e1689e8124c tempest-TaggedAttachmentsTest-1886546292 None] Lock "cinder-f24db707-b6e1-4493-a03f-835956a7f697-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:01:12 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be" returned: 0 in 0.493s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:12 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be Jul 21 19:01:12 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:12 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-31e9024e-21fb-4d62-95e3-21a7cd66c9be" returned: 0 in 0.254s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-31e9024e-21fb-4d62-95e3-21a7cd66c9be" released by "delete_volume" :: held 0.866s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:01:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "cinder-quobyte-748d0363-b976-48f4-9621-f73b195bebb5" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-748d0363-b976-48f4-9621-f73b195bebb5" acquired by "delete_volume" :: waited 0.026s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:12 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd3bf43-141f-4291-9820-8fe0ac131226]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:12 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5 Jul 21 19:01:12 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:13 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5" returned: 0 in 0.656s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:13 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5 Jul 21 19:01:13 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:13 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-748d0363-b976-48f4-9621-f73b195bebb5" returned: 0 in 0.547s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-748d0363-b976-48f4-9621-f73b195bebb5" released by "delete_volume" :: held 1.310s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:01:13 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=96,cinder:UPDATE=76,cinder:INSERT=15,cinder:DELETE=3 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:01:14 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=77,cinder:SELECT=92,cinder:DELETE=2,cinder:INSERT=18 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:01:14 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Created reservations ['f098f6ec-f7ac-4b78-a734-7f2c54d8c1dc'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:01:14 devstack cinder-volume[87570]: WARNING cinder.quota [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-881180914 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-881180914, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:01:14 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Created reservations ['5719caa1-2a83-4e5c-9c73-b24240fc1a94', '6ca0031f-2c2b-489d-89ea-e8f0dacd9671', '19838556-afa0-4213-830c-944e46b9a2ab', '425dc9ce-2998-432e-861f-667e7ed27ba3'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:01:14 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Created reservations ['a9d8d656-e655-446e-bc1d-3bbc3fbed626', 'bc5f1171-f7b0-4243-96f0-284613868010', '7d57b6d1-f233-49fc-9a14-2ebe5ced4085', 'bcf61e50-91d3-4f3c-9d83-10e9fc11f308'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:01:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:01:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:01:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:14 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:01:14 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:15 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.383s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:15 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:01:15 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-007d56d7-8bba-497e-8915-fcc6eb4d7045 tempest-GroupSnapshotsTest-2076344213 None] Delete group completed successfully. Jul 21 19:01:15 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-6212790e-9a30-4abf-b432-e67649e0c8e8 req-61beb983-b7e0-4330-bf85-928bae971f23 tempest-DeleteServersTestJSON-543547252 None] Terminate volume connection completed successfully. Jul 21 19:01:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-6212790e-9a30-4abf-b432-e67649e0c8e8 req-61beb983-b7e0-4330-bf85-928bae971f23 tempest-DeleteServersTestJSON-543547252 None] Deleting attachment 4a7bc2d6-9b14-4ff9-9f54-a2f5fef2a3f4. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:01:16 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-53a48887-9fdf-4802-9eb3-06fbdf701a2f tempest-GroupSnapshotsTest-2076344213 None] Group tempest-GroupSnapshotsTest-Group-1037744604: creating Jul 21 19:01:16 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-53a48887-9fdf-4802-9eb3-06fbdf701a2f tempest-GroupSnapshotsTest-2076344213 None] Group tempest-GroupSnapshotsTest-Group-1037744604: created successfully Jul 21 19:01:16 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-53a48887-9fdf-4802-9eb3-06fbdf701a2f tempest-GroupSnapshotsTest-2076344213 None] Create group completed successfully. Jul 21 19:01:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] Acquiring lock "cinder-390bbc10-6bc3-4042-875f-bbfc009771fb-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] Lock "cinder-390bbc10-6bc3-4042-875f-bbfc009771fb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] Acquiring lock "cinder-quobyte-390bbc10-6bc3-4042-875f-bbfc009771fb" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] Lock "cinder-quobyte-390bbc10-6bc3-4042-875f-bbfc009771fb" acquired by "delete_volume" :: waited 0.015s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:17 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a626d20e-0a85-4c62-9628-940c9db6fb84]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-390bbc10-6bc3-4042-875f-bbfc009771fb {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:17 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-390bbc10-6bc3-4042-875f-bbfc009771fb Jul 21 19:01:17 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:17 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-390bbc10-6bc3-4042-875f-bbfc009771fb" returned: 0 in 0.445s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-390bbc10-6bc3-4042-875f-bbfc009771fb {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:17 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-390bbc10-6bc3-4042-875f-bbfc009771fb Jul 21 19:01:17 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:17 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-390bbc10-6bc3-4042-875f-bbfc009771fb" returned: 0 in 0.323s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] Lock "cinder-quobyte-390bbc10-6bc3-4042-875f-bbfc009771fb" released by "delete_volume" :: held 0.830s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:01:17 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] Created reservations ['4e4a8b8b-a3fc-46a2-81da-9d2bb4d26274', '768f655d-605b-4765-a0b2-4548f1824a5c', '4a466bf1-4368-4496-ab52-d1f9869797f3', 'b95a9603-b160-4c09-8da7-8b6e9f7fdf23'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:01:18 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:01:18 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Flow 'volume_create_manager' (1a1e869e-7e45-4188-ad5c-7931cc4ab550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468eaca1-86d6-415f-9579-b711ae412e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468eaca1-86d6-415f-9579-b711ae412e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-717945161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fbd150e4-e5b5-471c-9aeb-c5a14c598563,host='devstack@QuobyteHD#QuobyteHD',id=6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb1c0e3808a4f0b8057aee37e523998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:01:18Z,use_quota=True,user_id='dfca8b3d26ef4f2ea8ee14f560b85c3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df5e3306-05ed-460a-9436-dd4c7b6e8216),volume_type_id=df5e3306-05ed-460a-9436-dd4c7b6e8216)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d208fe-c38a-4259-a0c9-e70fa303ac4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d208fe-c38a-4259-a0c9-e70fa303ac4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82650a31-c1ec-4852-ac18-bf1291f41488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82650a31-c1ec-4852-ac18-bf1291f41488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f', 'volume_name': 'volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d58d49-d4fa-4cd0-8a0f-30cf1ec3fd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d58d49-d4fa-4cd0-8a0f-30cf1ec3fd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1011831d-cd14-4900-a154-008f77e7777d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:18 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Volume 6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f', 'volume_size': 1} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fbd150e4-e5b5-471c-9aeb-c5a14c598563,created_at=2026-07-21T17:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-717945161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fbd150e4-e5b5-471c-9aeb-c5a14c598563,host='devstack@QuobyteHD#QuobyteHD',id=6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb1c0e3808a4f0b8057aee37e523998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:01:18Z,use_quota=True,user_id='dfca8b3d26ef4f2ea8ee14f560b85c3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df5e3306-05ed-460a-9436-dd4c7b6e8216),volume_type_id=df5e3306-05ed-460a-9436-dd4c7b6e8216)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Creating volume 6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:01:18 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:18 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f 1073741824 Jul 21 19:01:18 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:18 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.406s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:01:18 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] Deleted volume successfully. Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c9832d28-ca87-44e1-9641-9136c38d4e44 tempest-DeleteServersTestJSON-543547252 None] Lock "cinder-390bbc10-6bc3-4042-875f-bbfc009771fb-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:01:18 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f 1073741824" returned: 0 in 0.538s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:18 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f Jul 21 19:01:18 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:19 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f" returned: 0 in 0.263s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:19 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:01:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1011831d-cd14-4900-a154-008f77e7777d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28af9be-8f5f-479d-a894-6d149b57d273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:19 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Volume volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f (6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f): created successfully Jul 21 19:01:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28af9be-8f5f-479d-a894-6d149b57d273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Flow 'volume_create_manager' (1a1e869e-7e45-4188-ad5c-7931cc4ab550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:01:19 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-32876225-d51e-4972-b34b-2c42fb19b5df tempest-GroupSnapshotsTest-2076344213 None] Created volume successfully. Jul 21 19:01:19 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] GroupSnapshot 65ce6fcb-4dfe-4aa4-9a19-eba65f846ec3: creating. Jul 21 19:01:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] Group snapshot 65ce6fcb-4dfe-4aa4-9a19-eba65f846ec3: creating. {{(pid=87570) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 19:01:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:19 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] Creating offline snapshot 26d8d27a-58ea-4246-b9a9-78c379f2ff49 of volume 6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:01:19 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbfeb42-4e73-45b2-90fd-05914ee7aeaa]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:19 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f Jul 21 19:01:19 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:20 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f" returned: 0 in 0.450s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:20 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49 1G Jul 21 19:01:20 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:20 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49 1G" returned: 0 in 0.550s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:20 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49 Jul 21 19:01:20 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:21 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49" returned: 0 in 0.469s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:21 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:21 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49 Jul 21 19:01:21 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Flow 'volume_create_manager' (637c9f2a-6356-4066-8ba9-7209306b1ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5967059b-f5a9-4389-a89b-247927a0865d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5967059b-f5a9-4389-a89b-247927a0865d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-804977262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99148b23-476c-48b2-ab53-45a9efe11c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c365ec08ed4df9ae48638aa45783c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:01:21Z,use_quota=True,user_id='68bbe42e4c7a4e379fa7fd505bab0103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbab01a-bc82-4566-9ed7-6df66ed72d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbab01a-bc82-4566-9ed7-6df66ed72d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a05302-d2fc-456f-9e6e-ab6b0ff18348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a05302-d2fc-456f-9e6e-ab6b0ff18348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99148b23-476c-48b2-ab53-45a9efe11c19', 'volume_name': 'volume-99148b23-476c-48b2-ab53-45a9efe11c19', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24191de8-023c-4011-984c-3c58f041dbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24191de8-023c-4011-984c-3c58f041dbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a0d6ca-aa82-41c7-b9d7-b3c736a5a742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:21 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Volume 99148b23-476c-48b2-ab53-45a9efe11c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99148b23-476c-48b2-ab53-45a9efe11c19', 'volume_size': 1} Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:21 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49" returned: 0 in 0.433s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:21 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.info Jul 21 19:01:21 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:21 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.info" returned: 0 in 0.283s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:21 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:01:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:22 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.info Jul 21 19:01:22 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:22 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.info" returned: 0 in 0.343s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.634s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.790s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-804977262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99148b23-476c-48b2-ab53-45a9efe11c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c365ec08ed4df9ae48638aa45783c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:01:21Z,use_quota=True,user_id='68bbe42e4c7a4e379fa7fd505bab0103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:01:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Creating volume 99148b23-476c-48b2-ab53-45a9efe11c19 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:01:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:01:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:01:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:01:22 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:01:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99148b23-476c-48b2-ab53-45a9efe11c19 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:22 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99148b23-476c-48b2-ab53-45a9efe11c19 1073741824 Jul 21 19:01:22 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:22 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c660b6cf-dc79-4bb1-b36d-32b63674ab2f tempest-GroupSnapshotsTest-2076344213 None] group_snapshot 65ce6fcb-4dfe-4aa4-9a19-eba65f846ec3: created successfully Jul 21 19:01:22 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99148b23-476c-48b2-ab53-45a9efe11c19 1073741824" returned: 0 in 0.577s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99148b23-476c-48b2-ab53-45a9efe11c19 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:23 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99148b23-476c-48b2-ab53-45a9efe11c19 Jul 21 19:01:23 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:23 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] group_snapshot 65ce6fcb-4dfe-4aa4-9a19-eba65f846ec3: deleting Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] group_snapshot 65ce6fcb-4dfe-4aa4-9a19-eba65f846ec3: deleting {{(pid=87570) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "cinder-quobyte-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "cinder-quobyte-26d8d27a-58ea-4246-b9a9-78c379f2ff49" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-26d8d27a-58ea-4246-b9a9-78c379f2ff49" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] Deleting offline snapshot 26d8d27a-58ea-4246-b9a9-78c379f2ff49 of volume 6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:01:23 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] snapshot_file for this snap is: volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99148b23-476c-48b2-ab53-45a9efe11c19" returned: 0 in 0.330s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[b516dc12-cb57-442d-8ebd-4182d02db005]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a0d6ca-aa82-41c7-b9d7-b3c736a5a742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99148b23-476c-48b2-ab53-45a9efe11c19', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9297cf-4697-45ee-89df-918a571848f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:01:23 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Volume volume-99148b23-476c-48b2-ab53-45a9efe11c19 (99148b23-476c-48b2-ab53-45a9efe11c19): created successfully Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9297cf-4697-45ee-89df-918a571848f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Flow 'volume_create_manager' (637c9f2a-6356-4066-8ba9-7209306b1ada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:01:23 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-223b0f50-57ac-422c-a97c-fbeb1a70f0e9 tempest-ServerActionsTestOtherA-1430595666 None] Created volume successfully. Jul 21 19:01:23 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49 Jul 21 19:01:23 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:23 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49" returned: 0 in 0.549s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ce8e0f-76e0-460a-8899-bc66ca9ca19c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:24 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f Jul 21 19:01:24 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:24 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f" returned: 0 in 0.555s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:24 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49 Jul 21 19:01:24 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:25 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49" returned: 0 in 0.551s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:25 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49 Jul 21 19:01:25 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:25 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f.26d8d27a-58ea-4246-b9a9-78c379f2ff49" returned: 0 in 0.286s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-26d8d27a-58ea-4246-b9a9-78c379f2ff49" released by "_delete_snapshot" :: held 2.128s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:01:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f" released by "delete_snapshot" :: held 2.175s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:01:25 devstack cinder-volume[87570]: WARNING cinder.quota [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1141557832 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1141557832, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:01:25 devstack cinder-volume[87570]: WARNING cinder.quota [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1141557832 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1141557832, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:01:25 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] Created reservations ['128a5e57-3c5f-47e1-933f-7f10d0f4bbce', '7014bc45-0c2d-4dac-a9aa-cd35fa9802f4', '1003f8c1-8b9a-4aea-b7ae-28a8274a7a7a', '713e9f70-9265-4919-b201-5fbe5e022426'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:01:25 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-734d23ad-3e2d-4a53-9107-66bf3a6fb4a1 tempest-GroupSnapshotsTest-2076344213 None] group_snapshot 65ce6fcb-4dfe-4aa4-9a19-eba65f846ec3: deleted successfully Jul 21 19:01:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "cinder-quobyte-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:01:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:01:27 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67acd36-919d-45fb-8338-95dcee82de21]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:01:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:27 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f Jul 21 19:01:27 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:27 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f" returned: 0 in 0.490s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:27 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f Jul 21 19:01:27 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:28 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f" returned: 0 in 0.365s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] Lock "cinder-quobyte-6d1b1a12-ad5d-40d7-a7e8-a00c39235f1f" released by "delete_volume" :: held 0.944s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:01:28 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] Created reservations ['e891f831-3bac-4ca7-9021-a2f650f1486b'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:01:28 devstack cinder-volume[87570]: WARNING cinder.quota [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1141557832 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1141557832, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:01:28 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] Created reservations ['379ca310-6779-4990-ae43-f9e5579419d5', '1c4954a3-52b4-49a3-a7ea-8aff14fc2e18', '88a7781a-100e-4856-8539-3980acd2a6f3', 'ada8ba85-81b4-40e4-a19a-f04621733338'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:01:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:01:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:01:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:28 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:01:28 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:28 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.486s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:28 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:01:28 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-959b7017-87d0-4f07-8fd4-d2e38c55ed1e tempest-GroupSnapshotsTest-2076344213 None] Delete group completed successfully. Jul 21 19:01:38 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=48,cinder:UPDATE=51,cinder:INSERT=14,cinder:DELETE=1 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:01:38 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:INSERT=11,cinder:SELECT=40,cinder:UPDATE=53,cinder:DELETE=2 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:01:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:01:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:01:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:01:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:01:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:01:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:01:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:56 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:01:56 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:57 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 1.103s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:01:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:01:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 8 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:01:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:02:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-b81d4158-070e-44a7-9333-f5be71c83fef req-311781b3-f840-4318-8984-4528a3adeec2 tempest-ServerActionsTestOtherA-1430595666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-b81d4158-070e-44a7-9333-f5be71c83fef req-311781b3-f840-4318-8984-4528a3adeec2 tempest-ServerActionsTestOtherA-1430595666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-b81d4158-070e-44a7-9333-f5be71c83fef req-311781b3-f840-4318-8984-4528a3adeec2 tempest-ServerActionsTestOtherA-1430595666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-b81d4158-070e-44a7-9333-f5be71c83fef req-311781b3-f840-4318-8984-4528a3adeec2 tempest-ServerActionsTestOtherA-1430595666 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-99148b23-476c-48b2-ab53-45a9efe11c19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '19aa364e-e1a5-40e0-9419-7d6e0eab68c5', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:02:17 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-b81d4158-070e-44a7-9333-f5be71c83fef req-311781b3-f840-4318-8984-4528a3adeec2 tempest-ServerActionsTestOtherA-1430595666 None] attachment_update completed successfully. Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Flow 'volume_create_manager' (a85000d9-d05e-436a-8fab-09b03ae5d6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9149affc-84f7-440a-9b83-1fc8884883c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9149affc-84f7-440a-9b83-1fc8884883c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-604881173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33da7eb-e340-4822-94f0-3c6711f2e8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2370cc1331064a5fbd782387319d405a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:17Z,use_quota=True,user_id='acece91ea8514a7884518596ccc6f12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8126f2d0-b093-4192-93cd-b8c20fa729f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8126f2d0-b093-4192-93cd-b8c20fa729f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282f9ce7-17b8-4949-9559-a79872f22667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282f9ce7-17b8-4949-9559-a79872f22667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b33da7eb-e340-4822-94f0-3c6711f2e8aa', 'volume_name': 'volume-b33da7eb-e340-4822-94f0-3c6711f2e8aa', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7be29c-cb92-4bc0-9074-72a59c8bf360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7be29c-cb92-4bc0-9074-72a59c8bf360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c66656-b633-484c-8a97-acd2e13b6c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:17 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Volume b33da7eb-e340-4822-94f0-3c6711f2e8aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b33da7eb-e340-4822-94f0-3c6711f2e8aa', 'volume_size': 1} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-604881173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33da7eb-e340-4822-94f0-3c6711f2e8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2370cc1331064a5fbd782387319d405a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:17Z,use_quota=True,user_id='acece91ea8514a7884518596ccc6f12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Creating volume b33da7eb-e340-4822-94f0-3c6711f2e8aa {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:02:17 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:02:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b33da7eb-e340-4822-94f0-3c6711f2e8aa 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:17 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b33da7eb-e340-4822-94f0-3c6711f2e8aa 1073741824 Jul 21 19:02:17 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:18 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b33da7eb-e340-4822-94f0-3c6711f2e8aa 1073741824" returned: 0 in 0.693s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b33da7eb-e340-4822-94f0-3c6711f2e8aa {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:18 devstack sudo[91267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b33da7eb-e340-4822-94f0-3c6711f2e8aa Jul 21 19:02:18 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:18 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b33da7eb-e340-4822-94f0-3c6711f2e8aa" returned: 0 in 0.375s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:02:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c66656-b633-484c-8a97-acd2e13b6c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b33da7eb-e340-4822-94f0-3c6711f2e8aa', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae97d08a-f5a9-49db-9526-dc72158afba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:18 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Volume volume-b33da7eb-e340-4822-94f0-3c6711f2e8aa (b33da7eb-e340-4822-94f0-3c6711f2e8aa): created successfully Jul 21 19:02:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae97d08a-f5a9-49db-9526-dc72158afba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Flow 'volume_create_manager' (a85000d9-d05e-436a-8fab-09b03ae5d6dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:18 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-7dffb4a7-eca2-4074-9e2e-2d92445daa02 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Created volume successfully. Jul 21 19:02:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Acquiring lock "cinder-b33da7eb-e340-4822-94f0-3c6711f2e8aa-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Lock "cinder-b33da7eb-e340-4822-94f0-3c6711f2e8aa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Acquiring lock "cinder-quobyte-b33da7eb-e340-4822-94f0-3c6711f2e8aa" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Lock "cinder-quobyte-b33da7eb-e340-4822-94f0-3c6711f2e8aa" acquired by "delete_volume" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:19 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[134fb49f-6254-41c2-aec8-95b95e6c9942]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b33da7eb-e340-4822-94f0-3c6711f2e8aa {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:19 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b33da7eb-e340-4822-94f0-3c6711f2e8aa Jul 21 19:02:19 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:19 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:02:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Flow 'volume_create_manager' (b9deabbb-95dc-4d96-b68b-0906e51c0524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f8d5a1-b970-488a-829b-2dd4d7589077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f8d5a1-b970-488a-829b-2dd4d7589077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2061745898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac92ddf8-3de3-4d61-a815-fb3c67314528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9dfb1c7358f499f96a2db4e025e2fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:20Z,use_quota=True,user_id='ce90f54be0b546ce99e7d47913acba81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301f0816-fe1d-41fa-9276-1d7d99bf43af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301f0816-fe1d-41fa-9276-1d7d99bf43af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8bfa70f-229a-4574-b464-61f620367a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8bfa70f-229a-4574-b464-61f620367a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac92ddf8-3de3-4d61-a815-fb3c67314528', 'volume_name': 'volume-ac92ddf8-3de3-4d61-a815-fb3c67314528', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (527ca406-a921-498e-9775-5d56580c4b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (527ca406-a921-498e-9775-5d56580c4b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902f332a-041a-4d4c-a5fa-9cdc818fe976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:20 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Volume ac92ddf8-3de3-4d61-a815-fb3c67314528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac92ddf8-3de3-4d61-a815-fb3c67314528', 'volume_size': 1} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2061745898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac92ddf8-3de3-4d61-a815-fb3c67314528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9dfb1c7358f499f96a2db4e025e2fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:20Z,use_quota=True,user_id='ce90f54be0b546ce99e7d47913acba81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Creating volume ac92ddf8-3de3-4d61-a815-fb3c67314528 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:02:20 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac92ddf8-3de3-4d61-a815-fb3c67314528 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:20 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac92ddf8-3de3-4d61-a815-fb3c67314528 1073741824 Jul 21 19:02:20 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:20 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b33da7eb-e340-4822-94f0-3c6711f2e8aa" returned: 0 in 0.670s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b33da7eb-e340-4822-94f0-3c6711f2e8aa {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:20 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b33da7eb-e340-4822-94f0-3c6711f2e8aa Jul 21 19:02:20 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:20 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b33da7eb-e340-4822-94f0-3c6711f2e8aa" returned: 0 in 0.436s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Lock "cinder-quobyte-b33da7eb-e340-4822-94f0-3c6711f2e8aa" released by "delete_volume" :: held 1.208s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:20 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac92ddf8-3de3-4d61-a815-fb3c67314528 1073741824" returned: 0 in 0.747s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Created reservations ['81687077-c878-4771-8223-8f49302bc4d4', 'e1931acb-3347-4c43-a1f8-37617face214', 'fad1b4a6-7b42-41e1-8301-3bb1a2449888', '7bedea45-d1e7-4057-a2ad-22712be5eb0b'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac92ddf8-3de3-4d61-a815-fb3c67314528 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:20 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac92ddf8-3de3-4d61-a815-fb3c67314528 Jul 21 19:02:20 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:20 devstack sudo[91327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:02:20 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:21 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac92ddf8-3de3-4d61-a815-fb3c67314528" returned: 0 in 0.335s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:02:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902f332a-041a-4d4c-a5fa-9cdc818fe976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac92ddf8-3de3-4d61-a815-fb3c67314528', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40e2380-4e38-409a-a55f-5ba608958209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:21 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Volume volume-ac92ddf8-3de3-4d61-a815-fb3c67314528 (ac92ddf8-3de3-4d61-a815-fb3c67314528): created successfully Jul 21 19:02:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40e2380-4e38-409a-a55f-5ba608958209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Flow 'volume_create_manager' (b9deabbb-95dc-4d96-b68b-0906e51c0524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:21 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0c251df2-911a-43c3-be06-ea84fe53af58 tempest-ServersNegativeTestJSON-612588651 None] Created volume successfully. Jul 21 19:02:21 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.355s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:21 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:02:21 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Deleted volume successfully. Jul 21 19:02:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-64600875-6af6-4e5a-8001-6262146c10f9 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Lock "cinder-b33da7eb-e340-4822-94f0-3c6711f2e8aa-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Flow 'volume_create_manager' (9b10225b-c7b1-4015-8460-5a2267d77f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5838f52e-73e6-4858-beb6-1d626cd37188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5838f52e-73e6-4858-beb6-1d626cd37188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-736510083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814bafc4-4d4e-4335-890d-546bf45cdda3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2370cc1331064a5fbd782387319d405a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:22Z,use_quota=True,user_id='acece91ea8514a7884518596ccc6f12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b9b858-4a4e-415c-8b50-888a34cd216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b9b858-4a4e-415c-8b50-888a34cd216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5155b1-bbbc-449d-b8b6-e8135ca823f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5155b1-bbbc-449d-b8b6-e8135ca823f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '814bafc4-4d4e-4335-890d-546bf45cdda3', 'volume_name': 'volume-814bafc4-4d4e-4335-890d-546bf45cdda3', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf817ab2-4f67-43fe-b91a-0575c5524c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf817ab2-4f67-43fe-b91a-0575c5524c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38c797e-eff5-4851-b49d-33830ffb4810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:22 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Volume 814bafc4-4d4e-4335-890d-546bf45cdda3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-814bafc4-4d4e-4335-890d-546bf45cdda3', 'volume_size': 1} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-736510083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814bafc4-4d4e-4335-890d-546bf45cdda3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2370cc1331064a5fbd782387319d405a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:22Z,use_quota=True,user_id='acece91ea8514a7884518596ccc6f12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Creating volume 814bafc4-4d4e-4335-890d-546bf45cdda3 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:02:22 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-814bafc4-4d4e-4335-890d-546bf45cdda3 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:22 devstack sudo[91366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-814bafc4-4d4e-4335-890d-546bf45cdda3 1073741824 Jul 21 19:02:22 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:22 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-9fbd73cd-d2b5-44b9-99c5-09aac11eca7f req-d458cab8-d8d8-4216-b450-9370ee4c8877 tempest-ServerActionsTestOtherA-1430595666 None] Terminate volume connection completed successfully. Jul 21 19:02:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-9fbd73cd-d2b5-44b9-99c5-09aac11eca7f req-d458cab8-d8d8-4216-b450-9370ee4c8877 tempest-ServerActionsTestOtherA-1430595666 None] Deleting attachment 19aa364e-e1a5-40e0-9419-7d6e0eab68c5. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:02:23 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-814bafc4-4d4e-4335-890d-546bf45cdda3 1073741824" returned: 0 in 0.752s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-814bafc4-4d4e-4335-890d-546bf45cdda3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:23 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-814bafc4-4d4e-4335-890d-546bf45cdda3 Jul 21 19:02:23 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-9fbd73cd-d2b5-44b9-99c5-09aac11eca7f req-076946a6-60fe-43e3-a49e-048d570f1b3b tempest-ServerActionsTestOtherA-1430595666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:23 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-814bafc4-4d4e-4335-890d-546bf45cdda3" returned: 0 in 0.354s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-9fbd73cd-d2b5-44b9-99c5-09aac11eca7f req-076946a6-60fe-43e3-a49e-048d570f1b3b tempest-ServerActionsTestOtherA-1430595666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.175s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-9fbd73cd-d2b5-44b9-99c5-09aac11eca7f req-076946a6-60fe-43e3-a49e-048d570f1b3b tempest-ServerActionsTestOtherA-1430595666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38c797e-eff5-4851-b49d-33830ffb4810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-814bafc4-4d4e-4335-890d-546bf45cdda3', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17d45e1-698c-428b-ac4c-67b51bc21c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:23 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Volume volume-814bafc4-4d4e-4335-890d-546bf45cdda3 (814bafc4-4d4e-4335-890d-546bf45cdda3): created successfully Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17d45e1-698c-428b-ac4c-67b51bc21c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Flow 'volume_create_manager' (9b10225b-c7b1-4015-8460-5a2267d77f22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-9fbd73cd-d2b5-44b9-99c5-09aac11eca7f req-076946a6-60fe-43e3-a49e-048d570f1b3b tempest-ServerActionsTestOtherA-1430595666 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-99148b23-476c-48b2-ab53-45a9efe11c19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1f5b5f4-55f4-4604-9637-bada57e2f471', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:02:23 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-5eefb1e9-5c79-4979-8d22-95c948db5471 tempest-VolumeQuotasAdminTestJSON-1117289738 None] Created volume successfully. Jul 21 19:02:23 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-9fbd73cd-d2b5-44b9-99c5-09aac11eca7f req-076946a6-60fe-43e3-a49e-048d570f1b3b tempest-ServerActionsTestOtherA-1430595666 None] attachment_update completed successfully. Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Flow 'volume_create_manager' (721d22ce-17d7-4b4f-af4c-4f97d224be2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97787ac4-69d5-4fa4-8177-af1fa48f6f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97787ac4-69d5-4fa4-8177-af1fa48f6f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-400647927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab92c259-ee85-4eb0-ad58-c721e268bff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9dfb1c7358f499f96a2db4e025e2fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:24Z,use_quota=True,user_id='ce90f54be0b546ce99e7d47913acba81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e1ab08-7357-47cb-a381-f56bda798cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e1ab08-7357-47cb-a381-f56bda798cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444039d7-dcac-4642-be3a-40d936f559d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444039d7-dcac-4642-be3a-40d936f559d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab92c259-ee85-4eb0-ad58-c721e268bff6', 'volume_name': 'volume-ab92c259-ee85-4eb0-ad58-c721e268bff6', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cbc5e0-1988-4d89-b103-cfa68a988fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cbc5e0-1988-4d89-b103-cfa68a988fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad3b3d8-ed2c-477d-a0d9-2f77ca3dda95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:23 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Volume ab92c259-ee85-4eb0-ad58-c721e268bff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab92c259-ee85-4eb0-ad58-c721e268bff6', 'volume_size': 1} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-400647927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab92c259-ee85-4eb0-ad58-c721e268bff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9dfb1c7358f499f96a2db4e025e2fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:24Z,use_quota=True,user_id='ce90f54be0b546ce99e7d47913acba81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Creating volume ab92c259-ee85-4eb0-ad58-c721e268bff6 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:02:23 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:02:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab92c259-ee85-4eb0-ad58-c721e268bff6 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:23 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab92c259-ee85-4eb0-ad58-c721e268bff6 1073741824 Jul 21 19:02:23 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:24 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab92c259-ee85-4eb0-ad58-c721e268bff6 1073741824" returned: 0 in 0.498s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab92c259-ee85-4eb0-ad58-c721e268bff6 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:24 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab92c259-ee85-4eb0-ad58-c721e268bff6 Jul 21 19:02:24 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:24 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab92c259-ee85-4eb0-ad58-c721e268bff6" returned: 0 in 0.246s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:02:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad3b3d8-ed2c-477d-a0d9-2f77ca3dda95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab92c259-ee85-4eb0-ad58-c721e268bff6', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7bf39b-2779-4614-b449-fe2958890a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:24 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Volume volume-ab92c259-ee85-4eb0-ad58-c721e268bff6 (ab92c259-ee85-4eb0-ad58-c721e268bff6): created successfully Jul 21 19:02:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7bf39b-2779-4614-b449-fe2958890a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Flow 'volume_create_manager' (721d22ce-17d7-4b4f-af4c-4f97d224be2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:24 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-63af577f-b7db-41b3-9eae-590dc0d9d37b tempest-ServersNegativeTestJSON-612588651 None] Created volume successfully. Jul 21 19:02:25 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-3bce7058-c8ed-4508-a670-5cc93e246504 tempest-VolumeQuotasAdminTestJSON-528764889 None] Transfer volume completed successfully. Jul 21 19:02:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] Acquiring lock "cinder-814bafc4-4d4e-4335-890d-546bf45cdda3-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] Lock "cinder-814bafc4-4d4e-4335-890d-546bf45cdda3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] Acquiring lock "cinder-quobyte-814bafc4-4d4e-4335-890d-546bf45cdda3" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] Lock "cinder-quobyte-814bafc4-4d4e-4335-890d-546bf45cdda3" acquired by "delete_volume" :: waited 0.033s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:26 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd1a750-a8ed-4beb-820c-aeb419c72554]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-814bafc4-4d4e-4335-890d-546bf45cdda3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:26 devstack sudo[91851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-814bafc4-4d4e-4335-890d-546bf45cdda3 Jul 21 19:02:26 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] Acquiring lock "cinder-ab92c259-ee85-4eb0-ad58-c721e268bff6-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] Lock "cinder-ab92c259-ee85-4eb0-ad58-c721e268bff6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] Acquiring lock "cinder-quobyte-ab92c259-ee85-4eb0-ad58-c721e268bff6" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] Lock "cinder-quobyte-ab92c259-ee85-4eb0-ad58-c721e268bff6" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:26 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a473f07b-13c7-434d-82b7-0f18e4b43947]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab92c259-ee85-4eb0-ad58-c721e268bff6 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:26 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-814bafc4-4d4e-4335-890d-546bf45cdda3" returned: 0 in 0.459s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-814bafc4-4d4e-4335-890d-546bf45cdda3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:26 devstack sudo[91859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-814bafc4-4d4e-4335-890d-546bf45cdda3 Jul 21 19:02:26 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:26 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab92c259-ee85-4eb0-ad58-c721e268bff6 Jul 21 19:02:26 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:26 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-814bafc4-4d4e-4335-890d-546bf45cdda3" returned: 0 in 0.304s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] Lock "cinder-quobyte-814bafc4-4d4e-4335-890d-546bf45cdda3" released by "delete_volume" :: held 0.842s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] Created reservations ['bbc809a4-ffe6-4729-847e-f205a83848e0', 'baef3c9d-b41f-44ab-993f-775443d77e6c', '99da4c89-8704-4e71-b60f-c4c5cf7d2e86', 'e771660d-26f4-46ad-b44c-29aec3424a0a'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:27 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab92c259-ee85-4eb0-ad58-c721e268bff6" returned: 0 in 0.461s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab92c259-ee85-4eb0-ad58-c721e268bff6 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:27 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab92c259-ee85-4eb0-ad58-c721e268bff6 Jul 21 19:02:27 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:27 devstack sudo[91870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:02:27 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:27 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab92c259-ee85-4eb0-ad58-c721e268bff6" returned: 0 in 0.430s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] Lock "cinder-quobyte-ab92c259-ee85-4eb0-ad58-c721e268bff6" released by "delete_volume" :: held 0.949s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] Created reservations ['ae1274c8-f629-48b1-a994-8705275ca789', '17dbeb26-2da4-4949-a285-ee503d1647b5', '4d538a7e-6083-42bf-8c0e-ba92d4528ffe', '26cc612d-e200-4930-9fcf-a63fd8b53c60'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:27 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.510s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:02:27 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] Deleted volume successfully. Jul 21 19:02:27 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:02:27 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-058007dd-54be-43ce-9f7b-9040623eb093 tempest-VolumeQuotasAdminTestJSON-1806311316 None] Lock "cinder-814bafc4-4d4e-4335-890d-546bf45cdda3-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:28 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.372s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:28 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:02:28 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] Deleted volume successfully. Jul 21 19:02:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8d3e596f-aeb8-45a6-b03c-1b857e8992ef tempest-ServersNegativeTestJSON-612588651 None] Lock "cinder-ab92c259-ee85-4eb0-ad58-c721e268bff6-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] Acquiring lock "cinder-ac92ddf8-3de3-4d61-a815-fb3c67314528-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] Lock "cinder-ac92ddf8-3de3-4d61-a815-fb3c67314528-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] Acquiring lock "cinder-quobyte-ac92ddf8-3de3-4d61-a815-fb3c67314528" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:02:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] Lock "cinder-quobyte-ac92ddf8-3de3-4d61-a815-fb3c67314528" acquired by "delete_volume" :: waited 0.040s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:02:29 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d69884c-19fd-49c2-8eb8-10d239044b72]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac92ddf8-3de3-4d61-a815-fb3c67314528 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:29 devstack sudo[91878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac92ddf8-3de3-4d61-a815-fb3c67314528 Jul 21 19:02:29 devstack sudo[91878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:29 devstack sudo[91878]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac92ddf8-3de3-4d61-a815-fb3c67314528" returned: 0 in 0.412s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac92ddf8-3de3-4d61-a815-fb3c67314528 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:29 devstack sudo[91883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac92ddf8-3de3-4d61-a815-fb3c67314528 Jul 21 19:02:29 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:29 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac92ddf8-3de3-4d61-a815-fb3c67314528" returned: 0 in 0.311s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] Lock "cinder-quobyte-ac92ddf8-3de3-4d61-a815-fb3c67314528" released by "delete_volume" :: held 0.821s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:30 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] Created reservations ['27c46d58-806a-4e57-9cf2-fb894229a192', '9a185c8f-3c34-470a-92e4-596f7c97be25', 'd8be061e-1ff7-455c-b287-076edc9a74fe', 'b35914d8-fe8d-4f94-ba80-451c5cf51653'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:02:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:30 devstack sudo[91886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:02:30 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:30 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.529s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:30 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:02:30 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] Deleted volume successfully. Jul 21 19:02:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-37c53deb-2d6b-4e66-8fc5-87b824644453 tempest-ServersNegativeTestJSON-612588651 None] Lock "cinder-ac92ddf8-3de3-4d61-a815-fb3c67314528-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Flow 'volume_create_manager' (c23e5fed-4222-4018-8b4d-a672ec573c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b106ff-116e-4358-9b04-f1581b5fe053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b106ff-116e-4358-9b04-f1581b5fe053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-805597075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a64dca-5b27-494c-9e41-3958362f1a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f685c31f5d5548efb040c823517d2d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:34Z,use_quota=True,user_id='19b5d82e32ac4b4985d9977399f80c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (babaa8b2-1cac-4e2b-8710-eaf28d5d4fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (babaa8b2-1cac-4e2b-8710-eaf28d5d4fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df1b9b2-bc4d-4cd3-b09a-d4f5f956ac22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df1b9b2-bc4d-4cd3-b09a-d4f5f956ac22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a64dca-5b27-494c-9e41-3958362f1a46', 'volume_name': 'volume-f7a64dca-5b27-494c-9e41-3958362f1a46', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1e4dff-145b-49ac-83b0-8cbec545bcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1e4dff-145b-49ac-83b0-8cbec545bcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e03afd-0c8e-42ec-bb35-aea672841b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:33 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Volume f7a64dca-5b27-494c-9e41-3958362f1a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a64dca-5b27-494c-9e41-3958362f1a46', 'volume_size': 1} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-805597075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a64dca-5b27-494c-9e41-3958362f1a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f685c31f5d5548efb040c823517d2d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:34Z,use_quota=True,user_id='19b5d82e32ac4b4985d9977399f80c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Creating volume f7a64dca-5b27-494c-9e41-3958362f1a46 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:02:33 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:02:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f7a64dca-5b27-494c-9e41-3958362f1a46 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:33 devstack sudo[91922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f7a64dca-5b27-494c-9e41-3958362f1a46 1073741824 Jul 21 19:02:33 devstack sudo[91922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:34 devstack sudo[91922]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f7a64dca-5b27-494c-9e41-3958362f1a46 1073741824" returned: 0 in 0.614s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f7a64dca-5b27-494c-9e41-3958362f1a46 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:34 devstack sudo[91930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f7a64dca-5b27-494c-9e41-3958362f1a46 Jul 21 19:02:34 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:34 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f7a64dca-5b27-494c-9e41-3958362f1a46" returned: 0 in 0.330s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:02:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e03afd-0c8e-42ec-bb35-aea672841b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a64dca-5b27-494c-9e41-3958362f1a46', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc378f9e-6253-4b92-8470-dde3b2a333dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:34 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Volume volume-f7a64dca-5b27-494c-9e41-3958362f1a46 (f7a64dca-5b27-494c-9e41-3958362f1a46): created successfully Jul 21 19:02:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc378f9e-6253-4b92-8470-dde3b2a333dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Flow 'volume_create_manager' (c23e5fed-4222-4018-8b4d-a672ec573c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:35 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8b06d332-6508-4597-8a45-a91521b74de7 tempest-AttachVolumeTestJSON-207544691 None] Created volume successfully. Jul 21 19:02:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-ffbc3aa4-4a9d-4ac3-a128-ba86d20800db req-8f535aa9-1488-4acf-ba8a-b1525f4e1f7b tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-ffbc3aa4-4a9d-4ac3-a128-ba86d20800db req-8f535aa9-1488-4acf-ba8a-b1525f4e1f7b tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-ffbc3aa4-4a9d-4ac3-a128-ba86d20800db req-8f535aa9-1488-4acf-ba8a-b1525f4e1f7b tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-ffbc3aa4-4a9d-4ac3-a128-ba86d20800db req-8f535aa9-1488-4acf-ba8a-b1525f4e1f7b tempest-AttachVolumeTestJSON-207544691 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-f7a64dca-5b27-494c-9e41-3958362f1a46', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9980cc27-8c82-445f-842b-d1a9daafa5cb', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:02:37 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-ffbc3aa4-4a9d-4ac3-a128-ba86d20800db req-8f535aa9-1488-4acf-ba8a-b1525f4e1f7b tempest-AttachVolumeTestJSON-207544691 None] attachment_update completed successfully. Jul 21 19:02:47 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=52,cinder:UPDATE=49,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:02:47 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=50,cinder:UPDATE=54,cinder:INSERT=13,cinder:DELETE=6 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:02:52 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:02:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Flow 'volume_create_manager' (cc58c6e8-81ca-4515-aee9-cf5efe49eb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:02:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23a5686-c6a6-4272-b00b-fd39663a3dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23a5686-c6a6-4272-b00b-fd39663a3dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1025019957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bcd1a18-06d8-4619-a376-9c70908ce98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e73323d95c794398bed2370e7a3e1846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:52Z,use_quota=True,user_id='3acc8458b056404fba592ecac0532007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608e6db7-37d1-44a9-9e16-26ac27e15a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608e6db7-37d1-44a9-9e16-26ac27e15a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65178f7-9b3f-4fb2-8ab8-367c5feaba52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:52 devstack cinder-volume[87570]: DEBUG cinder.image.glance [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Creating Keystone auth plugin from conf {{(pid=87570) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:02:52 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-d3b410f5-1762-4e09-915d-36387385be82 req-a3756aee-bde0-4c6b-bb5d-7f0365452b75 tempest-ServerActionsTestOtherA-1430595666 None] Terminate volume connection completed successfully. Jul 21 19:02:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-d3b410f5-1762-4e09-915d-36387385be82 req-a3756aee-bde0-4c6b-bb5d-7f0365452b75 tempest-ServerActionsTestOtherA-1430595666 None] Deleting attachment b1f5b5f4-55f4-4604-9637-bada57e2f471. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:02:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65178f7-9b3f-4fb2-8ab8-367c5feaba52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3bcd1a18-06d8-4619-a376-9c70908ce98f', 'volume_name': 'volume-3bcd1a18-06d8-4619-a376-9c70908ce98f', 'volume_size': 1, 'image_id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d5947bfd6bf45059ad4d24acd0d802c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'created_at': datetime.datetime(2026, 7, 21, 16, 54, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9234f73-152c-4870-a64c-d508f1f6e33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9234f73-152c-4870-a64c-d508f1f6e33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:02:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8065d0b1-6fcf-4fad-b9c9-6aee66104255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:02:53 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Volume 3bcd1a18-06d8-4619-a376-9c70908ce98f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3bcd1a18-06d8-4619-a376-9c70908ce98f', 'volume_size': 1, 'image_id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d5947bfd6bf45059ad4d24acd0d802c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'created_at': datetime.datetime(2026, 7, 21, 16, 54, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 19:02:53 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Trying to clone 3bcd1a18-06d8-4619-a376-9c70908ce98f from image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}]). {{(pid=87570) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:02:53 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ui4an3n6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:02:53 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Image download 20.69 MB at 20.69 MB/s Jul 21 19:02:53 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6233258-af3d-4437-8667-07da6c80bac7]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ui4an3n6devstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:54 devstack sudo[92167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ui4an3n6devstack@QuobyteHD Jul 21 19:02:54 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:54 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ui4an3n6devstack@QuobyteHD" returned: 0 in 0.910s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:54 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Temporary image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 is fetched for user 3acc8458b056404fba592ecac0532007. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:02:55 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d8cdcd-da1f-44cc-9112-0cd838224124]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ui4an3n6devstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:55 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ui4an3n6devstack@QuobyteHD Jul 21 19:02:55 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:55 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ui4an3n6devstack@QuobyteHD" returned: 0 in 0.692s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1025019957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bcd1a18-06d8-4619-a376-9c70908ce98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e73323d95c794398bed2370e7a3e1846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:02:52Z,use_quota=True,user_id='3acc8458b056404fba592ecac0532007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:02:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Creating volume 3bcd1a18-06d8-4619-a376-9c70908ce98f {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:02:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:02:55 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:02:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:55 devstack sudo[92205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f 1073741824 Jul 21 19:02:55 devstack sudo[92205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:56 devstack sudo[92205]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f 1073741824" returned: 0 in 0.714s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:56 devstack sudo[92211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f Jul 21 19:02:56 devstack sudo[92211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:02:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:02:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:02:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:02:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:02:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:56 devstack sudo[92213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:02:56 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:57 devstack sudo[92211]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f" returned: 0 in 0.472s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:02:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:02:57 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Attempting download of 2235c2cf-4cba-41d7-9e54-acfbf60b7351 ((None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}])) to volume 3bcd1a18-06d8-4619-a376-9c70908ce98f. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:02:57 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe0dc5c-8379-4a8c-b5ef-ff44ca4367ed]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_xemsupbl {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:57 devstack sudo[92218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_xemsupbl Jul 21 19:02:57 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:57 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.602s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:02:57 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_xemsupbl" returned: 0 in 0.540s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_xemsupbl {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:58 devstack sudo[92224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_xemsupbl Jul 21 19:02:58 devstack sudo[92224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:58 devstack sudo[92224]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_xemsupbl" returned: 1 in 0.487s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_xemsupbl' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:02:58 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca993cb6-2f29-489b-bd1d-77fbacd22061]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:02:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ui4an3n6devstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:58 devstack sudo[92229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ui4an3n6devstack@QuobyteHD Jul 21 19:02:58 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:58 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ui4an3n6devstack@QuobyteHD" returned: 0 in 0.547s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:58 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] 2235c2cf-4cba-41d7-9e54-acfbf60b7351 was qcow2, converting to qcow2 {{(pid=87570) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:02:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ui4an3n6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:58 devstack sudo[92235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ui4an3n6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f Jul 21 19:02:58 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] Acquiring lock "cinder-99148b23-476c-48b2-ab53-45a9efe11c19-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:03:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] Lock "cinder-99148b23-476c-48b2-ab53-45a9efe11c19-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:03:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] Acquiring lock "cinder-quobyte-99148b23-476c-48b2-ab53-45a9efe11c19" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:03:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] Lock "cinder-quobyte-99148b23-476c-48b2-ab53-45a9efe11c19" acquired by "delete_volume" :: waited 0.028s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3d4cd7-4318-4023-85b7-a907f8572929]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99148b23-476c-48b2-ab53-45a9efe11c19 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:01 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99148b23-476c-48b2-ab53-45a9efe11c19 Jul 21 19:03:01 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:01 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:01 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ui4an3n6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f" returned: 0 in 2.617s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ui4an3n6devstack@QuobyteHD, size 112.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:03:01 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Converted 112.00 MB image at 42.76 MB/s Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99148b23-476c-48b2-ab53-45a9efe11c19" returned: 0 in 0.487s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99148b23-476c-48b2-ab53-45a9efe11c19 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:01 devstack sudo[92251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f 1G Jul 21 19:03:01 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:01 devstack sudo[92252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99148b23-476c-48b2-ab53-45a9efe11c19 Jul 21 19:03:01 devstack sudo[92252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:01 devstack sudo[92252]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99148b23-476c-48b2-ab53-45a9efe11c19" returned: 0 in 0.258s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] Lock "cinder-quobyte-99148b23-476c-48b2-ab53-45a9efe11c19" released by "delete_volume" :: held 0.804s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] Created reservations ['b3f368f9-d851-4c52-bc1b-8bb2bfbf681a', '0f5808c7-cbc9-44b7-ab39-c62c901266f7', 'b759615a-bdba-49c3-bc46-b5d874ca414c', '33801a76-8241-422a-a92c-021594d630f1'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:03:01 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f 1G" returned: 0 in 0.366s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Downloaded image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 ((None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}])) to volume 3bcd1a18-06d8-4619-a376-9c70908ce98f successfully. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Temporary image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 for user 3acc8458b056404fba592ecac0532007 is deleted. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Marking volume 3bcd1a18-06d8-4619-a376-9c70908ce98f as bootable. {{(pid=87570) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Copying metadata from image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 to 3bcd1a18-06d8-4619-a376-9c70908ce98f. {{(pid=87570) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Creating volume glance metadata for volume 3bcd1a18-06d8-4619-a376-9c70908ce98f backed by image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87570) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:01 devstack sudo[92259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:03:01 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8065d0b1-6fcf-4fad-b9c9-6aee66104255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bcd1a18-06d8-4619-a376-9c70908ce98f', 'volume_size': 1, 'image_id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d5947bfd6bf45059ad4d24acd0d802c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'created_at': datetime.datetime(2026, 7, 21, 16, 54, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5c98bb-385b-4a77-9d21-55ac7816283b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:02 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Volume volume-3bcd1a18-06d8-4619-a376-9c70908ce98f (3bcd1a18-06d8-4619-a376-9c70908ce98f): created successfully Jul 21 19:03:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5c98bb-385b-4a77-9d21-55ac7816283b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Flow 'volume_create_manager' (cc58c6e8-81ca-4515-aee9-cf5efe49eb89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:03:02 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4da4a54d-af23-4ab1-a689-3d36d8700f27 tempest-VolumesImageMetadata-72868829 None] Created volume successfully. Jul 21 19:03:02 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.328s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:02 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:03:02 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] Deleted volume successfully. Jul 21 19:03:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1967b58a-36c1-4134-a0bf-cf268a58f0be tempest-ServerActionsTestOtherA-1430595666 None] Lock "cinder-99148b23-476c-48b2-ab53-45a9efe11c19-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:03:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] Acquiring lock "cinder-3bcd1a18-06d8-4619-a376-9c70908ce98f-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:03:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] Lock "cinder-3bcd1a18-06d8-4619-a376-9c70908ce98f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:03:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] Acquiring lock "cinder-quobyte-3bcd1a18-06d8-4619-a376-9c70908ce98f" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:03:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] Lock "cinder-quobyte-3bcd1a18-06d8-4619-a376-9c70908ce98f" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:03:03 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e9cddb-f295-4a5d-aea2-70b4e8ea75b4]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:03:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:03 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f Jul 21 19:03:03 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:03 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f" returned: 0 in 0.472s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:03 devstack sudo[92294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f Jul 21 19:03:03 devstack sudo[92294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:03 devstack sudo[92294]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3bcd1a18-06d8-4619-a376-9c70908ce98f" returned: 0 in 0.284s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] Lock "cinder-quobyte-3bcd1a18-06d8-4619-a376-9c70908ce98f" released by "delete_volume" :: held 0.817s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:03:04 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] Created reservations ['be93ea28-3398-443f-9c81-3217d4093387', '3f306b43-86ad-4716-a502-9860f64b8eae', '80cb0832-db46-4413-be5f-88973c519086', 'f44f4edd-3e4e-45e3-ad11-d092732b1a36'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:03:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:04 devstack sudo[92301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:03:04 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:04 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.454s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:04 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:03:04 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] Deleted volume successfully. Jul 21 19:03:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4bcb9f47-9789-4766-8298-188bc7e8e27f tempest-VolumesImageMetadata-72868829 None] Lock "cinder-3bcd1a18-06d8-4619-a376-9c70908ce98f-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Flow 'volume_create_manager' (5f6bbaa7-33ab-4fab-ac16-3fd08782a5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c713ade-1630-4110-84c2-365b4c253ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c713ade-1630-4110-84c2-365b4c253ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1968844807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154a4e24-b01c-467e-afaf-2aa24a84b3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02b80d90c9434fcb8eef7be05a0fa110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:03:08Z,use_quota=True,user_id='00f96b5ed0a34b5d81cf84b5d13e2ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03eac70-5a51-4c38-8ada-4f4b6d9c841a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03eac70-5a51-4c38-8ada-4f4b6d9c841a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b234480-3930-4bc9-98a4-0f04dc53e4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b234480-3930-4bc9-98a4-0f04dc53e4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '154a4e24-b01c-467e-afaf-2aa24a84b3db', 'volume_name': 'volume-154a4e24-b01c-467e-afaf-2aa24a84b3db', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0501d1-a908-435c-85ce-9275d9b836a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0501d1-a908-435c-85ce-9275d9b836a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4c6eb6-2aab-45b7-beaa-0b35f32b68bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:08 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Volume 154a4e24-b01c-467e-afaf-2aa24a84b3db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-154a4e24-b01c-467e-afaf-2aa24a84b3db', 'volume_size': 1} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1968844807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154a4e24-b01c-467e-afaf-2aa24a84b3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02b80d90c9434fcb8eef7be05a0fa110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:03:08Z,use_quota=True,user_id='00f96b5ed0a34b5d81cf84b5d13e2ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Creating volume 154a4e24-b01c-467e-afaf-2aa24a84b3db {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:03:08 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:03:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:08 devstack sudo[92331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db 1073741824 Jul 21 19:03:08 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:09 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-9590d08c-c4e9-42dc-aac2-a761cd5497b1 req-3def89ae-54b2-4139-94db-16b7deb8d197 tempest-AttachVolumeTestJSON-207544691 None] Terminate volume connection completed successfully. Jul 21 19:03:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-9590d08c-c4e9-42dc-aac2-a761cd5497b1 req-3def89ae-54b2-4139-94db-16b7deb8d197 tempest-AttachVolumeTestJSON-207544691 None] Deleting attachment 9980cc27-8c82-445f-842b-d1a9daafa5cb. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:03:09 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db 1073741824" returned: 0 in 0.708s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:09 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db Jul 21 19:03:09 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:09 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db" returned: 0 in 0.347s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:03:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4c6eb6-2aab-45b7-beaa-0b35f32b68bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154a4e24-b01c-467e-afaf-2aa24a84b3db', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43983cec-0349-44f9-8ee8-a1bfa449e3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:09 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Volume volume-154a4e24-b01c-467e-afaf-2aa24a84b3db (154a4e24-b01c-467e-afaf-2aa24a84b3db): created successfully Jul 21 19:03:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43983cec-0349-44f9-8ee8-a1bfa449e3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Flow 'volume_create_manager' (5f6bbaa7-33ab-4fab-ac16-3fd08782a5e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:03:09 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-14e9a3c7-7e19-402d-bbe7-b9a7dd78c6d5 tempest-SnapshotMetadataTestJSON-2056879107 None] Created volume successfully. Jul 21 19:03:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] Creating offline snapshot 7c2640ea-f50f-4cda-9bc7-3f3b2080f649 of volume 154a4e24-b01c-467e-afaf-2aa24a84b3db {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:03:11 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae1d438-13a0-457b-a2ee-7605609c7456]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:03:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:11 devstack sudo[92390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db Jul 21 19:03:11 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:11 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db" returned: 0 in 0.727s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:11 devstack sudo[92422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649 1G Jul 21 19:03:11 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:12 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649 1G" returned: 0 in 0.964s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-154a4e24-b01c-467e-afaf-2aa24a84b3db -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:12 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-154a4e24-b01c-467e-afaf-2aa24a84b3db -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649 Jul 21 19:03:12 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:13 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-154a4e24-b01c-467e-afaf-2aa24a84b3db -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649" returned: 0 in 0.683s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:13 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649 is being set with open permissions: ugo+rw Jul 21 19:03:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:13 devstack sudo[92441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649 Jul 21 19:03:13 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:13 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649" returned: 0 in 0.401s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:14 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.info Jul 21 19:03:14 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:14 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.info" returned: 0 in 0.631s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:14 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.info is being set with open permissions: ugo+rw Jul 21 19:03:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:14 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.info Jul 21 19:03:14 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:15 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.info" returned: 0 in 0.779s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.471s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:15 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c80504b4-daa5-4792-b360-e1e7c53ab544 tempest-SnapshotMetadataTestJSON-2056879107 None] Create snapshot completed successfully Jul 21 19:03:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Acquiring lock "cinder-7c2640ea-f50f-4cda-9bc7-3f3b2080f649-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:03:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "cinder-7c2640ea-f50f-4cda-9bc7-3f3b2080f649-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:03:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Acquiring lock "cinder-quobyte-154a4e24-b01c-467e-afaf-2aa24a84b3db" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:03:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "cinder-quobyte-154a4e24-b01c-467e-afaf-2aa24a84b3db" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:03:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Acquiring lock "cinder-quobyte-7c2640ea-f50f-4cda-9bc7-3f3b2080f649" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:03:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "cinder-quobyte-7c2640ea-f50f-4cda-9bc7-3f3b2080f649" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:03:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Deleting offline snapshot 7c2640ea-f50f-4cda-9bc7-3f3b2080f649 of volume 154a4e24-b01c-467e-afaf-2aa24a84b3db {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:03:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] snapshot_file for this snap is: volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:03:18 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9289f76-45e0-44cf-a2a2-319d350dc10c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:03:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:19 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649 Jul 21 19:03:19 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:19 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649" returned: 0 in 0.925s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:19 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-154a4e24-b01c-467e-afaf-2aa24a84b3db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:03:19 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bbe7e9-6fa5-46a2-9c19-25ed77ed4d29]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:03:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:19 devstack sudo[92596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db Jul 21 19:03:19 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:20 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db" returned: 0 in 0.550s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:20 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649 Jul 21 19:03:20 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:20 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649" returned: 0 in 0.688s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:21 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649 Jul 21 19:03:21 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:21 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db.7c2640ea-f50f-4cda-9bc7-3f3b2080f649" returned: 0 in 0.584s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "cinder-quobyte-7c2640ea-f50f-4cda-9bc7-3f3b2080f649" released by "_delete_snapshot" :: held 3.022s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:03:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "cinder-quobyte-154a4e24-b01c-467e-afaf-2aa24a84b3db" released by "delete_snapshot" :: held 3.069s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:03:21 devstack cinder-volume[87570]: WARNING cinder.quota [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:03:21 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Created reservations ['b0ee5edb-6388-43d6-b0ef-1a47a1138173', '0a1a9945-97e1-41d7-84b0-f0c7850dc838', '2d36e39a-857a-4c48-bf7d-56ad36c4dfae', 'ab2b406d-67d5-491d-ab9c-1834a5b157c9'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:03:21 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Delete snapshot completed successfully. Jul 21 19:03:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6369234e-f944-4cd7-b258-ae3a377b2dae tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "cinder-7c2640ea-f50f-4cda-9bc7-3f3b2080f649-delete_snapshot" released by "delete_snapshot" :: held 3.344s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:03:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] Acquiring lock "cinder-154a4e24-b01c-467e-afaf-2aa24a84b3db-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:03:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "cinder-154a4e24-b01c-467e-afaf-2aa24a84b3db-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:03:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] Acquiring lock "cinder-quobyte-154a4e24-b01c-467e-afaf-2aa24a84b3db" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:03:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "cinder-quobyte-154a4e24-b01c-467e-afaf-2aa24a84b3db" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:03:23 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ef994d-6427-418d-b285-3cbbe245382f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:03:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:23 devstack sudo[92610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db Jul 21 19:03:23 devstack sudo[92610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:23 devstack sudo[92610]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db" returned: 0 in 0.485s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:23 devstack sudo[92615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db Jul 21 19:03:23 devstack sudo[92615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:24 devstack sudo[92615]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-154a4e24-b01c-467e-afaf-2aa24a84b3db" returned: 0 in 0.521s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "cinder-quobyte-154a4e24-b01c-467e-afaf-2aa24a84b3db" released by "delete_volume" :: held 1.108s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:03:24 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] Created reservations ['4ad1c53d-6f72-4bc2-9bba-5596d04a41be', 'df929a3d-2683-4bb0-a044-ac6f62bf9ede', 'ff71c0b3-aeff-4d3a-a156-ba5d5052ecdc', 'f779ba3d-ec94-42c0-af96-4d1110ca8464'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:03:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:24 devstack sudo[92619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:03:24 devstack sudo[92619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:24 devstack sudo[92619]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.404s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:24 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:03:24 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] Deleted volume successfully. Jul 21 19:03:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-120138bb-cb6e-428d-8fea-3f755be0a8fc tempest-SnapshotMetadataTestJSON-2056879107 None] Lock "cinder-154a4e24-b01c-467e-afaf-2aa24a84b3db-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Flow 'volume_create_manager' (4def078f-029c-438e-88ff-d3b8731bac73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd23165a-4fca-495a-9361-ac21bae87194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd23165a-4fca-495a-9361-ac21bae87194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-859000076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a72c5642-fef6-4449-8143-52842735f7e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad76f8894fb4fc2bdb64201518a0fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:03:31Z,use_quota=True,user_id='f0d7a2ee39974889868a0bd7c1d7ba96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1487ea21-a693-43f9-8d18-a55ce7f7c444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1487ea21-a693-43f9-8d18-a55ce7f7c444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ecec0c2-176c-4600-9c43-4e0ae681dbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ecec0c2-176c-4600-9c43-4e0ae681dbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a72c5642-fef6-4449-8143-52842735f7e8', 'volume_name': 'volume-a72c5642-fef6-4449-8143-52842735f7e8', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eae70db-4e3d-445b-ad7d-9a9293e146fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eae70db-4e3d-445b-ad7d-9a9293e146fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e75332-94ca-4ff3-a0f7-cdffc1448d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:31 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Volume a72c5642-fef6-4449-8143-52842735f7e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a72c5642-fef6-4449-8143-52842735f7e8', 'volume_size': 1} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-859000076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a72c5642-fef6-4449-8143-52842735f7e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad76f8894fb4fc2bdb64201518a0fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:03:31Z,use_quota=True,user_id='f0d7a2ee39974889868a0bd7c1d7ba96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Creating volume a72c5642-fef6-4449-8143-52842735f7e8 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:03:31 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:03:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a72c5642-fef6-4449-8143-52842735f7e8 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:31 devstack sudo[92642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a72c5642-fef6-4449-8143-52842735f7e8 1073741824 Jul 21 19:03:31 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:32 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a72c5642-fef6-4449-8143-52842735f7e8 1073741824" returned: 0 in 0.590s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a72c5642-fef6-4449-8143-52842735f7e8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:32 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a72c5642-fef6-4449-8143-52842735f7e8 Jul 21 19:03:32 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:32 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a72c5642-fef6-4449-8143-52842735f7e8" returned: 0 in 0.287s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:32 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:03:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e75332-94ca-4ff3-a0f7-cdffc1448d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a72c5642-fef6-4449-8143-52842735f7e8', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7838c8-bf2a-4f86-ab28-239e2a3e648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:32 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Volume volume-a72c5642-fef6-4449-8143-52842735f7e8 (a72c5642-fef6-4449-8143-52842735f7e8): created successfully Jul 21 19:03:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7838c8-bf2a-4f86-ab28-239e2a3e648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Flow 'volume_create_manager' (4def078f-029c-438e-88ff-d3b8731bac73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:03:32 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-9b55c782-c0b6-44dd-841e-bffb64b64508 tempest-AbsoluteLimitsTests-1915483067 None] Created volume successfully. Jul 21 19:03:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] Acquiring lock "cinder-a72c5642-fef6-4449-8143-52842735f7e8-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:03:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] Lock "cinder-a72c5642-fef6-4449-8143-52842735f7e8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:03:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] Acquiring lock "cinder-quobyte-a72c5642-fef6-4449-8143-52842735f7e8" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:03:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] Lock "cinder-quobyte-a72c5642-fef6-4449-8143-52842735f7e8" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:03:33 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ac4dba-c289-4cb6-bd7a-f9ec5e711186]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:03:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a72c5642-fef6-4449-8143-52842735f7e8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:33 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a72c5642-fef6-4449-8143-52842735f7e8 Jul 21 19:03:33 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:34 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a72c5642-fef6-4449-8143-52842735f7e8" returned: 0 in 0.474s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a72c5642-fef6-4449-8143-52842735f7e8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:34 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a72c5642-fef6-4449-8143-52842735f7e8 Jul 21 19:03:34 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:34 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a72c5642-fef6-4449-8143-52842735f7e8" returned: 0 in 0.390s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] Lock "cinder-quobyte-a72c5642-fef6-4449-8143-52842735f7e8" released by "delete_volume" :: held 0.923s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:03:34 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] Created reservations ['c1696dad-bff5-4089-ba6d-bf1e5e318c1a', 'cb2b1188-f9d4-4a35-8c3a-793d310849f9', '1f829fa9-ff79-4e52-8f15-fd7ba36bb626', '55b9e906-a99f-4d35-b408-703eef419d31'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:03:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:34 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:03:34 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:35 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.429s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:35 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:03:35 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] Deleted volume successfully. Jul 21 19:03:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c5a24ff5-a6ae-457c-857f-1080f6a261b2 tempest-AbsoluteLimitsTests-1915483067 None] Lock "cinder-a72c5642-fef6-4449-8143-52842735f7e8-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Flow 'volume_create_manager' (b63055e0-49a3-46a6-b196-6e60c84dad2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce9cf75-9733-40f2-bee7-fc42d03c7060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce9cf75-9733-40f2-bee7-fc42d03c7060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1658526097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de4b377-d849-47a2-994f-eb0e207230b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0676da5a3c474112b1ca01855a642d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:03:38Z,use_quota=True,user_id='e7945a42613c46dca744dacdbebb4b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b284ab-d23d-4d7b-8254-b5997c5738cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b284ab-d23d-4d7b-8254-b5997c5738cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e72e189-fa20-40a3-b4e3-23961fa9d545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e72e189-fa20-40a3-b4e3-23961fa9d545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0de4b377-d849-47a2-994f-eb0e207230b9', 'volume_name': 'volume-0de4b377-d849-47a2-994f-eb0e207230b9', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc29f4a-e964-47a8-bd0a-7be79308f347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc29f4a-e964-47a8-bd0a-7be79308f347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9846d194-76fa-4338-bda3-636898bc937e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:38 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Volume 0de4b377-d849-47a2-994f-eb0e207230b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0de4b377-d849-47a2-994f-eb0e207230b9', 'volume_size': 1} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1658526097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de4b377-d849-47a2-994f-eb0e207230b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0676da5a3c474112b1ca01855a642d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:03:38Z,use_quota=True,user_id='e7945a42613c46dca744dacdbebb4b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Creating volume 0de4b377-d849-47a2-994f-eb0e207230b9 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:03:38 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0de4b377-d849-47a2-994f-eb0e207230b9 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:38 devstack sudo[92725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0de4b377-d849-47a2-994f-eb0e207230b9 1073741824 Jul 21 19:03:38 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:38 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0de4b377-d849-47a2-994f-eb0e207230b9 1073741824" returned: 0 in 0.641s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0de4b377-d849-47a2-994f-eb0e207230b9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:39 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0de4b377-d849-47a2-994f-eb0e207230b9 Jul 21 19:03:39 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:39 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0de4b377-d849-47a2-994f-eb0e207230b9" returned: 0 in 0.328s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:03:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9846d194-76fa-4338-bda3-636898bc937e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0de4b377-d849-47a2-994f-eb0e207230b9', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccac5b4f-6023-4d33-97d1-a3dcee1798af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:39 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Volume volume-0de4b377-d849-47a2-994f-eb0e207230b9 (0de4b377-d849-47a2-994f-eb0e207230b9): created successfully Jul 21 19:03:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccac5b4f-6023-4d33-97d1-a3dcee1798af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Flow 'volume_create_manager' (b63055e0-49a3-46a6-b196-6e60c84dad2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:03:39 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4df34ac0-44c1-4d89-8273-c6d19792d6da tempest-AttachVolumeNegativeTest-1325674848 None] Created volume successfully. Jul 21 19:03:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-206ab5a3-031f-4dcc-b386-3fbb84c632e2 req-641a8889-6664-4c10-b6e7-66588106a74d tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-206ab5a3-031f-4dcc-b386-3fbb84c632e2 req-641a8889-6664-4c10-b6e7-66588106a74d tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-206ab5a3-031f-4dcc-b386-3fbb84c632e2 req-641a8889-6664-4c10-b6e7-66588106a74d tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.115s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-206ab5a3-031f-4dcc-b386-3fbb84c632e2 req-641a8889-6664-4c10-b6e7-66588106a74d tempest-AttachVolumeNegativeTest-1325674848 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-0de4b377-d849-47a2-994f-eb0e207230b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60239ad0-2f2c-463c-8c0c-1dc6aaeed8d4', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:03:43 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-206ab5a3-031f-4dcc-b386-3fbb84c632e2 req-641a8889-6664-4c10-b6e7-66588106a74d tempest-AttachVolumeNegativeTest-1325674848 None] attachment_update completed successfully. Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=47,cinder:UPDATE=58,cinder:INSERT=24,cinder:DELETE=5 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=52,cinder:SELECT=61,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Flow 'volume_create_manager' (6ababbba-dfb3-47aa-8f11-76f673d1a4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f3bee1c-a9cd-4c55-9bbd-3db8a4dfc8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f3bee1c-a9cd-4c55-9bbd-3db8a4dfc8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1876796252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2fbb01-16fc-46b0-8fff-dd076fe585bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b66fbac4fa7146c698092dcc26924fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:03:49Z,use_quota=True,user_id='bf39c7a1b9da442d8c0fd49aff570868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850c0493-9481-4466-867e-4ce556e7af53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850c0493-9481-4466-867e-4ce556e7af53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451336ea-cd99-4146-808f-119907927feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451336ea-cd99-4146-808f-119907927feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a2fbb01-16fc-46b0-8fff-dd076fe585bd', 'volume_name': 'volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e72a2bb-ee29-4612-b543-28e185ab134d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e72a2bb-ee29-4612-b543-28e185ab134d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feea1012-dac7-4558-a00b-909efa859bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:49 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Volume 5a2fbb01-16fc-46b0-8fff-dd076fe585bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd', 'volume_size': 1} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1876796252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2fbb01-16fc-46b0-8fff-dd076fe585bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b66fbac4fa7146c698092dcc26924fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:03:49Z,use_quota=True,user_id='bf39c7a1b9da442d8c0fd49aff570868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Creating volume 5a2fbb01-16fc-46b0-8fff-dd076fe585bd {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:03:49 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:03:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:49 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd 1073741824 Jul 21 19:03:49 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:50 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd 1073741824" returned: 0 in 1.106s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:50 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd Jul 21 19:03:50 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:51 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd" returned: 0 in 0.529s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:03:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feea1012-dac7-4558-a00b-909efa859bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80add21-da53-48bd-8cf0-3f333611cc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:51 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Volume volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd (5a2fbb01-16fc-46b0-8fff-dd076fe585bd): created successfully Jul 21 19:03:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80add21-da53-48bd-8cf0-3f333611cc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Flow 'volume_create_manager' (6ababbba-dfb3-47aa-8f11-76f673d1a4d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:03:51 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-df0c8a02-4364-4aa8-8221-42955f18c350 tempest-VolumesDeleteCascade-1115585104 None] Created volume successfully. Jul 21 19:03:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] Creating offline snapshot 24e7db67-f770-45d9-a673-d2944040b42a of volume 5a2fbb01-16fc-46b0-8fff-dd076fe585bd {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:03:52 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0012ef3-9076-451e-94b7-fc01844a0a6a]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:03:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:53 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd Jul 21 19:03:53 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:53 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd" returned: 0 in 0.611s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:53 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a 1G Jul 21 19:03:53 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:54 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a 1G" returned: 0 in 0.959s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:54 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a Jul 21 19:03:54 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:55 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a" returned: 0 in 0.984s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:55 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a is being set with open permissions: ugo+rw Jul 21 19:03:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:55 devstack sudo[93358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a Jul 21 19:03:55 devstack sudo[93358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:56 devstack sudo[93358]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a" returned: 0 in 0.748s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:56 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.info Jul 21 19:03:56 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:03:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:56 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:03:56 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:57 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.info" returned: 0 in 0.765s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:57 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.info is being set with open permissions: ugo+rw Jul 21 19:03:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:57 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.info Jul 21 19:03:57 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:57 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.525s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:03:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:03:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:03:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:03:57 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.info" returned: 0 in 0.511s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.840s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:57 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4c32cf00-c8ee-4ab9-9441-e7aeb442b19c tempest-VolumesDeleteCascade-1115585104 None] Create snapshot completed successfully Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Flow 'volume_create_manager' (f593db82-217f-4b32-8e5b-ccbabe8d7144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9f106c-4b9f-400d-8509-4988715731a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9f106c-4b9f-400d-8509-4988715731a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1963833409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99236f63-3f13-4cf6-8d1b-c418518bb3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbc0686898a4b33acc25e2d9ace592b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:03:58Z,use_quota=True,user_id='4557ba498a864499803774daa01fa300',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7b030c-a32e-4abc-90c1-07a75da7cfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7b030c-a32e-4abc-90c1-07a75da7cfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64224a2-acfb-45fd-9af3-93d5cb470753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64224a2-acfb-45fd-9af3-93d5cb470753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99236f63-3f13-4cf6-8d1b-c418518bb3fb', 'volume_name': 'volume-99236f63-3f13-4cf6-8d1b-c418518bb3fb', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeee3277-f75e-4ba9-a6aa-218c6e2acd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeee3277-f75e-4ba9-a6aa-218c6e2acd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04271c33-2145-4e2e-bf97-389ff35ae7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:58 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Volume 99236f63-3f13-4cf6-8d1b-c418518bb3fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99236f63-3f13-4cf6-8d1b-c418518bb3fb', 'volume_size': 1} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1963833409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99236f63-3f13-4cf6-8d1b-c418518bb3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbc0686898a4b33acc25e2d9ace592b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:03:58Z,use_quota=True,user_id='4557ba498a864499803774daa01fa300',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Creating volume 99236f63-3f13-4cf6-8d1b-c418518bb3fb {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:03:58 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99236f63-3f13-4cf6-8d1b-c418518bb3fb 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:58 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99236f63-3f13-4cf6-8d1b-c418518bb3fb 1073741824 Jul 21 19:03:58 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5ad12f61-2e1b-4f1a-80bf-e731d6c5d984 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:03:59 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99236f63-3f13-4cf6-8d1b-c418518bb3fb 1073741824" returned: 0 in 1.009s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99236f63-3f13-4cf6-8d1b-c418518bb3fb {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:59 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99236f63-3f13-4cf6-8d1b-c418518bb3fb Jul 21 19:03:59 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:59 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99236f63-3f13-4cf6-8d1b-c418518bb3fb" returned: 0 in 0.405s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:03:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:03:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5ad12f61-2e1b-4f1a-80bf-e731d6c5d984 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.022s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:03:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04271c33-2145-4e2e-bf97-389ff35ae7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99236f63-3f13-4cf6-8d1b-c418518bb3fb', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:03:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6026b0b-ed6c-44d9-9a5d-c3c7756fb1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:03:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-5ad12f61-2e1b-4f1a-80bf-e731d6c5d984 tempest-VolumesDeleteCascade-1115585104 None] Creating offline snapshot fd400dbc-7faa-4025-8903-f733ee7daa09 of volume 5a2fbb01-16fc-46b0-8fff-dd076fe585bd {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:03:59 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Volume volume-99236f63-3f13-4cf6-8d1b-c418518bb3fb (99236f63-3f13-4cf6-8d1b-c418518bb3fb): created successfully Jul 21 19:04:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6026b0b-ed6c-44d9-9a5d-c3c7756fb1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Flow 'volume_create_manager' (f593db82-217f-4b32-8e5b-ccbabe8d7144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:00 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bcd168-fb7d-4937-b3f1-ef2c06dcf78c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5ad12f61-2e1b-4f1a-80bf-e731d6c5d984 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:00 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-180edd5c-c6f6-4e58-82e8-e9e05354f153 tempest-ServerRescueNegativeTestJSON-745147132 None] Created volume successfully. Jul 21 19:04:00 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a Jul 21 19:04:00 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:00 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5ad12f61-2e1b-4f1a-80bf-e731d6c5d984 tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a" returned: 0 in 0.647s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-5ad12f61-2e1b-4f1a-80bf-e731d6c5d984 tempest-VolumesDeleteCascade-1115585104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:04:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5ad12f61-2e1b-4f1a-80bf-e731d6c5d984 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:00 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 1G Jul 21 19:04:00 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:01 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5ad12f61-2e1b-4f1a-80bf-e731d6c5d984 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 1G" returned: 0 in 0.803s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5ad12f61-2e1b-4f1a-80bf-e731d6c5d984 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:01 devstack sudo[93427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 Jul 21 19:04:01 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:02 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5ad12f61-2e1b-4f1a-80bf-e731d6c5d984 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09" returned: 0 in 0.739s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:02 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-5ad12f61-2e1b-4f1a-80bf-e731d6c5d984 tempest-VolumesDeleteCascade-1115585104 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 is being set with open permissions: ugo+rw Jul 21 19:04:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5ad12f61-2e1b-4f1a-80bf-e731d6c5d984 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:02 devstack sudo[93433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 Jul 21 19:04:02 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:02 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5ad12f61-2e1b-4f1a-80bf-e731d6c5d984 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09" returned: 0 in 0.454s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5ad12f61-2e1b-4f1a-80bf-e731d6c5d984 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.895s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:02 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-5ad12f61-2e1b-4f1a-80bf-e731d6c5d984 tempest-VolumesDeleteCascade-1115585104 None] Create snapshot completed successfully Jul 21 19:04:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "cinder-5a2fbb01-16fc-46b0-8fff-dd076fe585bd-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-5a2fbb01-16fc-46b0-8fff-dd076fe585bd-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Performing cascade delete. {{(pid=87570) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 21 19:04:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "cinder-24e7db67-f770-45d9-a673-d2944040b42a-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-24e7db67-f770-45d9-a673-d2944040b42a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "cinder-quobyte-5a2fbb01-16fc-46b0-8fff-dd076fe585bd" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-5a2fbb01-16fc-46b0-8fff-dd076fe585bd" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "cinder-quobyte-24e7db67-f770-45d9-a673-d2944040b42a" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-24e7db67-f770-45d9-a673-d2944040b42a" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Deleting offline snapshot 24e7db67-f770-45d9-a673-d2944040b42a of volume 5a2fbb01-16fc-46b0-8fff-dd076fe585bd {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:04:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] snapshot_file for this snap is: volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:04:03 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ca454a-bc12-476f-89b4-d125a9b387c6]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:04 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a Jul 21 19:04:04 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:04 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a" returned: 0 in 0.971s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:04:05 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[d547abe0-e8c1-4e09-b4b0-4ab54c2febd1]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:05 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd Jul 21 19:04:05 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:05 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd" returned: 0 in 1.000s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:06 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae71789-1533-409b-8aa0-2e04f8ba27f5]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:06 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 Jul 21 19:04:06 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:07 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09" returned: 0 in 0.874s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:04:07 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b659f35-d18f-4cbe-a79d-ee53d9518e87]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:07 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a Jul 21 19:04:07 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:08 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a" returned: 0 in 1.350s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:04:08 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a1f1c4-abc2-4e16-a11e-183d132ceb5f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:08 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd Jul 21 19:04:08 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:09 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd" returned: 0 in 0.763s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:09 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a Jul 21 19:04:09 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:10 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a" returned: 0 in 0.785s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:10 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a Jul 21 19:04:10 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:10 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.24e7db67-f770-45d9-a673-d2944040b42a" returned: 0 in 0.717s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 -F qcow2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:10 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 -F qcow2 Jul 21 19:04:10 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:11 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 -F qcow2" returned: 0 in 0.892s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-24e7db67-f770-45d9-a673-d2944040b42a" released by "_delete_snapshot" :: held 7.917s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-5a2fbb01-16fc-46b0-8fff-dd076fe585bd" released by "delete_snapshot" :: held 7.985s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:11 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Created reservations ['5f6a44e7-fbcf-45ba-b4a8-a64203358be9', '39b5b9c5-d938-4f83-b186-1d46b8040a99', '4f777d73-cdea-4d44-8321-1967c50b9883', 'b60e5b27-778c-4632-ac02-dac7b4460467'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:04:12 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Delete snapshot completed successfully. Jul 21 19:04:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-24e7db67-f770-45d9-a673-d2944040b42a-delete_snapshot" released by "delete_snapshot" :: held 8.517s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "cinder-fd400dbc-7faa-4025-8903-f733ee7daa09-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-fd400dbc-7faa-4025-8903-f733ee7daa09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.124s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "cinder-quobyte-5a2fbb01-16fc-46b0-8fff-dd076fe585bd" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-5a2fbb01-16fc-46b0-8fff-dd076fe585bd" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "cinder-quobyte-fd400dbc-7faa-4025-8903-f733ee7daa09" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-fd400dbc-7faa-4025-8903-f733ee7daa09" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:12 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Deleting offline snapshot fd400dbc-7faa-4025-8903-f733ee7daa09 of volume 5a2fbb01-16fc-46b0-8fff-dd076fe585bd {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:04:12 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] snapshot_file for this snap is: volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:04:12 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[f141ad8b-6058-4564-810f-372435628583]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:13 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 Jul 21 19:04:13 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:13 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09" returned: 0 in 1.086s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:04:13 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c45bfc7-2b1f-4a77-b1dc-81544b2fc55e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:14 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd Jul 21 19:04:14 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:14 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd" returned: 0 in 1.001s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:14 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 Jul 21 19:04:15 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:15 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09" returned: 0 in 1.000s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:15 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09 Jul 21 19:04:15 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:16 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd.fd400dbc-7faa-4025-8903-f733ee7daa09" returned: 0 in 0.330s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-fd400dbc-7faa-4025-8903-f733ee7daa09" released by "_delete_snapshot" :: held 3.807s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-5a2fbb01-16fc-46b0-8fff-dd076fe585bd" released by "delete_snapshot" :: held 3.869s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:16 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Created reservations ['16b3a12c-1e4d-467e-b063-2d4a208efb87', 'a7e47bfc-d18d-424e-8526-e8a02260c557', 'efc15bcb-8b6d-48f3-bab7-3b44dffa2f3b', '483bf47b-255d-4b65-b7b8-eab52fd97833'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:04:16 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Delete snapshot completed successfully. Jul 21 19:04:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-fd400dbc-7faa-4025-8903-f733ee7daa09-delete_snapshot" released by "delete_snapshot" :: held 4.227s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Snapshots deleted, issuing volume delete {{(pid=87570) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 21 19:04:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "cinder-quobyte-5a2fbb01-16fc-46b0-8fff-dd076fe585bd" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-5a2fbb01-16fc-46b0-8fff-dd076fe585bd" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:16 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d869ea-fb89-4183-9749-7e96c91987e8]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:16 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd Jul 21 19:04:16 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:17 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] Acquiring lock "cinder-99236f63-3f13-4cf6-8d1b-c418518bb3fb-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd" returned: 0 in 0.890s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] Lock "cinder-99236f63-3f13-4cf6-8d1b-c418518bb3fb-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:17 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd Jul 21 19:04:17 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] Acquiring lock "cinder-quobyte-99236f63-3f13-4cf6-8d1b-c418518bb3fb" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] Lock "cinder-quobyte-99236f63-3f13-4cf6-8d1b-c418518bb3fb" acquired by "delete_volume" :: waited 0.055s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:17 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5072de-fbfe-45e4-9d35-a04323c81060]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99236f63-3f13-4cf6-8d1b-c418518bb3fb {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:18 devstack sudo[93770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99236f63-3f13-4cf6-8d1b-c418518bb3fb Jul 21 19:04:18 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:18 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5a2fbb01-16fc-46b0-8fff-dd076fe585bd" returned: 0 in 0.713s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-5a2fbb01-16fc-46b0-8fff-dd076fe585bd" released by "delete_volume" :: held 1.733s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:18 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Created reservations ['eed916bf-08a6-4376-9d96-e3e976dc898f', '5813dca3-b807-4ade-a4cf-763b77d68444', 'd7cee1aa-030f-4a1f-b64d-25d0c986a1d3', '78c95199-d414-4191-92bd-73596bfa03b2'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:04:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:18 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:04:18 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:18 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99236f63-3f13-4cf6-8d1b-c418518bb3fb" returned: 0 in 1.050s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99236f63-3f13-4cf6-8d1b-c418518bb3fb {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:18 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99236f63-3f13-4cf6-8d1b-c418518bb3fb Jul 21 19:04:18 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:19 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.810s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:19 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:04:19 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Deleted volume successfully. Jul 21 19:04:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-de854fe6-febe-45a0-bd88-bb7262aabe46 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-5a2fbb01-16fc-46b0-8fff-dd076fe585bd-delete_volume" released by "delete_volume" :: held 16.117s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:19 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-99236f63-3f13-4cf6-8d1b-c418518bb3fb" returned: 0 in 0.693s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] Lock "cinder-quobyte-99236f63-3f13-4cf6-8d1b-c418518bb3fb" released by "delete_volume" :: held 1.835s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:19 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] Created reservations ['c695fd97-f306-4785-a9da-eb563be89c42', 'a406c632-4f94-4050-8dd6-54045326be88', '85eb36d1-1da5-44fc-a384-b25c536e0b27', '7a022409-e34b-4e19-be32-55d0916ebef6'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:04:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:20 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:04:20 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:21 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Flow 'volume_create_manager' (185f32c1-7845-4c4e-95c6-0e190841c418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1d7d9b-6044-4d51-a154-ead82f74cb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 1.148s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:04:21 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] Deleted volume successfully. Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1d7d9b-6044-4d51-a154-ead82f74cb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-564151186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0d25fe-4df3-47d3-8bae-0203750d3434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b66fbac4fa7146c698092dcc26924fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:21Z,use_quota=True,user_id='bf39c7a1b9da442d8c0fd49aff570868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11c009e-ec84-4aeb-b75e-6aba71fb5622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11c009e-ec84-4aeb-b75e-6aba71fb5622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf2bb6c-c13a-4d91-8de5-ace86bc3d6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf2bb6c-c13a-4d91-8de5-ace86bc3d6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed0d25fe-4df3-47d3-8bae-0203750d3434', 'volume_name': 'volume-ed0d25fe-4df3-47d3-8bae-0203750d3434', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460342ed-1dfb-480e-bcfb-587d06f534c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460342ed-1dfb-480e-bcfb-587d06f534c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22bf617b-bd0f-4669-81bc-7a0befd10495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:21 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Volume ed0d25fe-4df3-47d3-8bae-0203750d3434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed0d25fe-4df3-47d3-8bae-0203750d3434', 'volume_size': 1} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-564151186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0d25fe-4df3-47d3-8bae-0203750d3434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b66fbac4fa7146c698092dcc26924fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:21Z,use_quota=True,user_id='bf39c7a1b9da442d8c0fd49aff570868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Creating volume ed0d25fe-4df3-47d3-8bae-0203750d3434 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:04:21 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:21 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 1073741824 Jul 21 19:04:21 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-db5795eb-6bd9-4060-9020-ce06b748f4fd tempest-ServerRescueNegativeTestJSON-745147132 None] Lock "cinder-99236f63-3f13-4cf6-8d1b-c418518bb3fb-delete_volume" released by "delete_volume" :: held 3.882s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:22 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 1073741824" returned: 0 in 1.068s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:22 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 Jul 21 19:04:22 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:23 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434" returned: 0 in 0.702s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:04:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22bf617b-bd0f-4669-81bc-7a0befd10495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed0d25fe-4df3-47d3-8bae-0203750d3434', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f944187d-a5ee-4d26-b545-ef0317318b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:23 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Volume volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 (ed0d25fe-4df3-47d3-8bae-0203750d3434): created successfully Jul 21 19:04:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f944187d-a5ee-4d26-b545-ef0317318b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Flow 'volume_create_manager' (185f32c1-7845-4c4e-95c6-0e190841c418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:23 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-a2b9d7c9-206c-4cd0-a2c3-f146c0e0c477 tempest-VolumesDeleteCascade-1115585104 None] Created volume successfully. Jul 21 19:04:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] Creating offline snapshot 1170ae93-4a49-47b7-b22a-1e1d595e0b32 of volume ed0d25fe-4df3-47d3-8bae-0203750d3434 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:04:24 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88aae20-7b12-4cd6-8e98-af0213e78f47]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:24 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 Jul 21 19:04:24 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:24 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434" returned: 0 in 0.520s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:24 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32 1G Jul 21 19:04:24 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:25 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32 1G" returned: 0 in 0.720s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:25 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32 Jul 21 19:04:25 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:26 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32" returned: 0 in 0.404s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:26 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32 is being set with open permissions: ugo+rw Jul 21 19:04:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:26 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32 Jul 21 19:04:26 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:26 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32" returned: 0 in 0.472s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:26 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.info Jul 21 19:04:26 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:26 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.info" returned: 0 in 0.302s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:26 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.info is being set with open permissions: ugo+rw Jul 21 19:04:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:26 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.info Jul 21 19:04:26 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:27 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.info" returned: 0 in 0.309s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.869s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:27 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-46348926-8e3a-4aa0-ba1e-6cfbda59b467 tempest-VolumesDeleteCascade-1115585104 None] Create snapshot completed successfully Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Flow 'volume_create_manager' (79733e84-8d3d-4010-9ecf-92b82ab403d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f967a7a-4c29-4167-8d2f-4f9b7bf248b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f967a7a-4c29-4167-8d2f-4f9b7bf248b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1596519503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b42bae9-76c9-48eb-a462-baa1d212cc83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b66fbac4fa7146c698092dcc26924fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1170ae93-4a49-47b7-b22a-1e1d595e0b32,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:28Z,use_quota=True,user_id='bf39c7a1b9da442d8c0fd49aff570868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0da971-639b-4305-826c-b0bf27f4ea72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0da971-639b-4305-826c-b0bf27f4ea72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc03c43d-457a-4931-af59-af43fccb644a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc03c43d-457a-4931-af59-af43fccb644a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9b42bae9-76c9-48eb-a462-baa1d212cc83', 'volume_name': 'volume-9b42bae9-76c9-48eb-a462-baa1d212cc83', 'volume_size': 1, 'snapshot_id': '1170ae93-4a49-47b7-b22a-1e1d595e0b32'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a18e1b5-7892-4b84-bb29-30babb8a4e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a18e1b5-7892-4b84-bb29-30babb8a4e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd302728-821d-47d4-bd98-46e2a8d55b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:28 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Volume 9b42bae9-76c9-48eb-a462-baa1d212cc83: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9b42bae9-76c9-48eb-a462-baa1d212cc83', 'volume_size': 1, 'snapshot_id': '1170ae93-4a49-47b7-b22a-1e1d595e0b32'} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "cinder-quobyte-1170ae93-4a49-47b7-b22a-1e1d595e0b32-9b42bae9-76c9-48eb-a462-baa1d212cc83" by "_create_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-1170ae93-4a49-47b7-b22a-1e1d595e0b32-9b42bae9-76c9-48eb-a462-baa1d212cc83" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Creating volume 9b42bae9-76c9-48eb-a462-baa1d212cc83 from snapshot 1170ae93-4a49-47b7-b22a-1e1d595e0b32 {{(pid=87570) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "cinder-quobyte-9b42bae9-76c9-48eb-a462-baa1d212cc83" by "_copy_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-9b42bae9-76c9-48eb-a462-baa1d212cc83" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] snapshot: 1170ae93-4a49-47b7-b22a-1e1d595e0b32, volume: 9b42bae9-76c9-48eb-a462-baa1d212cc83, {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[70744e6a-cf09-44aa-955a-6f3bc9e7d13c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:28 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32 Jul 21 19:04:28 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:28 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32" returned: 0 in 0.440s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed0d25fe-4df3-47d3-8bae-0203750d3434(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Creating direct copy from snapshot {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3208de2-8036-4055-ab28-27f622745ac3]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:29 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 Jul 21 19:04:29 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:29 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434" returned: 0 in 0.455s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:29 devstack cinder-volume[87570]: DEBUG cinder.utils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Path /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9b42bae9-76c9-48eb-a462-baa1d212cc83 not found in is_blk_device check {{(pid=87570) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:04:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9b42bae9-76c9-48eb-a462-baa1d212cc83 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:29 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9b42bae9-76c9-48eb-a462-baa1d212cc83 Jul 21 19:04:29 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:35 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9b42bae9-76c9-48eb-a462-baa1d212cc83" returned: 0 in 6.519s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:35 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74908e3-64c6-421e-b732-055cd7555f04]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:36 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 Jul 21 19:04:36 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:36 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434" returned: 0 in 0.601s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:36 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Image conversion details: src /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9b42bae9-76c9-48eb-a462-baa1d212cc83 {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:04:36 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Converted 1024.00 MB image at 157.05 MB/s Jul 21 19:04:36 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9b42bae9-76c9-48eb-a462-baa1d212cc83 is being set with open permissions: ugo+rw Jul 21 19:04:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9b42bae9-76c9-48eb-a462-baa1d212cc83 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:36 devstack sudo[94011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9b42bae9-76c9-48eb-a462-baa1d212cc83 Jul 21 19:04:36 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:36 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9b42bae9-76c9-48eb-a462-baa1d212cc83" returned: 0 in 0.262s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-9b42bae9-76c9-48eb-a462-baa1d212cc83" released by "_copy_volume_from_snapshot" :: held 8.395s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-1170ae93-4a49-47b7-b22a-1e1d595e0b32-9b42bae9-76c9-48eb-a462-baa1d212cc83" released by "_create_volume_from_snapshot" :: held 8.442s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.459s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd302728-821d-47d4-bd98-46e2a8d55b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b42bae9-76c9-48eb-a462-baa1d212cc83', 'volume_size': 1, 'snapshot_id': '1170ae93-4a49-47b7-b22a-1e1d595e0b32'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ac48c9-9364-4424-a993-6d614285fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:36 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Volume volume-9b42bae9-76c9-48eb-a462-baa1d212cc83 (9b42bae9-76c9-48eb-a462-baa1d212cc83): created successfully Jul 21 19:04:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ac48c9-9364-4424-a993-6d614285fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Flow 'volume_create_manager' (79733e84-8d3d-4010-9ecf-92b82ab403d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:36 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-88e63d72-c5fa-4707-97ff-f29afd911eb6 tempest-VolumesDeleteCascade-1115585104 None] Created volume successfully. Jul 21 19:04:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "cinder-ed0d25fe-4df3-47d3-8bae-0203750d3434-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-ed0d25fe-4df3-47d3-8bae-0203750d3434-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Performing cascade delete. {{(pid=87570) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 21 19:04:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "cinder-1170ae93-4a49-47b7-b22a-1e1d595e0b32-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-1170ae93-4a49-47b7-b22a-1e1d595e0b32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "cinder-quobyte-ed0d25fe-4df3-47d3-8bae-0203750d3434" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-ed0d25fe-4df3-47d3-8bae-0203750d3434" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "cinder-quobyte-1170ae93-4a49-47b7-b22a-1e1d595e0b32" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-1170ae93-4a49-47b7-b22a-1e1d595e0b32" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Deleting offline snapshot 1170ae93-4a49-47b7-b22a-1e1d595e0b32 of volume ed0d25fe-4df3-47d3-8bae-0203750d3434 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:04:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] snapshot_file for this snap is: volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:04:37 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[733869ba-952e-486e-91f2-7da297e0089d]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:38 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32 Jul 21 19:04:38 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:38 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32" returned: 0 in 0.407s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed0d25fe-4df3-47d3-8bae-0203750d3434(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:04:38 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[1586dd99-a051-48ba-9c6a-2889161cdca0]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:38 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 Jul 21 19:04:38 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:38 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434" returned: 0 in 0.420s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:38 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32 Jul 21 19:04:38 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:39 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32" returned: 0 in 0.453s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:39 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32 Jul 21 19:04:39 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:39 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434.1170ae93-4a49-47b7-b22a-1e1d595e0b32" returned: 0 in 0.327s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-1170ae93-4a49-47b7-b22a-1e1d595e0b32" released by "_delete_snapshot" :: held 1.719s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-ed0d25fe-4df3-47d3-8bae-0203750d3434" released by "delete_snapshot" :: held 1.749s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:39 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Created reservations ['82326cf1-288b-4cba-b7f9-27d21bb0f43e', 'ab853b93-a8e4-49a0-8fa0-aca2fa3b5b1e', '7f0e0b9b-185f-4a33-8d7b-b6926bc74037', '2383ffde-511c-4872-980a-fce9354dc2e2'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:04:39 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Delete snapshot completed successfully. Jul 21 19:04:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-1170ae93-4a49-47b7-b22a-1e1d595e0b32-delete_snapshot" released by "delete_snapshot" :: held 1.965s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Snapshots deleted, issuing volume delete {{(pid=87570) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 21 19:04:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "cinder-quobyte-ed0d25fe-4df3-47d3-8bae-0203750d3434" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-ed0d25fe-4df3-47d3-8bae-0203750d3434" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:39 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8637e36-bc4f-4157-89dc-ab89b21df9f2]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:40 devstack sudo[94044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 Jul 21 19:04:40 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Flow 'volume_create_manager' (494edc0c-c59a-4c46-87af-97d030265675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1532174-5590-4c82-83f2-71220bc3d422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1532174-5590-4c82-83f2-71220bc3d422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1370755642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00623b93-7de5-4d53-937a-3dedf9904092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f685c31f5d5548efb040c823517d2d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:40Z,use_quota=True,user_id='19b5d82e32ac4b4985d9977399f80c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e59c274-6360-47d1-bdaf-9e787e87171c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e59c274-6360-47d1-bdaf-9e787e87171c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9be2f81-6330-4d0c-978a-20325bfd0046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9be2f81-6330-4d0c-978a-20325bfd0046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00623b93-7de5-4d53-937a-3dedf9904092', 'volume_name': 'volume-00623b93-7de5-4d53-937a-3dedf9904092', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecdcfa11-d202-4aad-87fa-b1c8c99eaff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecdcfa11-d202-4aad-87fa-b1c8c99eaff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e838fa-b794-4365-bc94-ac08f8746c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:40 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Volume 00623b93-7de5-4d53-937a-3dedf9904092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00623b93-7de5-4d53-937a-3dedf9904092', 'volume_size': 1} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1370755642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00623b93-7de5-4d53-937a-3dedf9904092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f685c31f5d5548efb040c823517d2d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:40Z,use_quota=True,user_id='19b5d82e32ac4b4985d9977399f80c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Creating volume 00623b93-7de5-4d53-937a-3dedf9904092 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:04:40 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-00623b93-7de5-4d53-937a-3dedf9904092 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:40 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-00623b93-7de5-4d53-937a-3dedf9904092 1073741824 Jul 21 19:04:40 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:40 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434" returned: 0 in 0.432s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:40 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434 Jul 21 19:04:40 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:40 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ed0d25fe-4df3-47d3-8bae-0203750d3434" returned: 0 in 0.294s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-ed0d25fe-4df3-47d3-8bae-0203750d3434" released by "delete_volume" :: held 0.793s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:40 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-00623b93-7de5-4d53-937a-3dedf9904092 1073741824" returned: 0 in 0.545s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Created reservations ['0ed8c257-c043-4d5b-b3ff-99839b2252a3', '2f697a77-ac15-4866-87d1-a2e8f049746a', 'd9469838-40ca-4b3c-9027-8657208a66a6', 'd0b415f5-813a-4b29-977d-7f03a6abbbab'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-00623b93-7de5-4d53-937a-3dedf9904092 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:40 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-00623b93-7de5-4d53-937a-3dedf9904092 Jul 21 19:04:40 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:40 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:04:40 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:41 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-00623b93-7de5-4d53-937a-3dedf9904092" returned: 0 in 0.326s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:41 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e838fa-b794-4365-bc94-ac08f8746c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00623b93-7de5-4d53-937a-3dedf9904092', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4030df9c-9143-456c-bb89-eb96d9c4bf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.305s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:04:41 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Deleted volume successfully. Jul 21 19:04:41 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Volume volume-00623b93-7de5-4d53-937a-3dedf9904092 (00623b93-7de5-4d53-937a-3dedf9904092): created successfully Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4030df9c-9143-456c-bb89-eb96d9c4bf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Flow 'volume_create_manager' (494edc0c-c59a-4c46-87af-97d030265675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4778c496-5070-49eb-9f56-4f691d61e9d2 tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-ed0d25fe-4df3-47d3-8bae-0203750d3434-delete_volume" released by "delete_volume" :: held 3.376s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:41 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f55131b1-501a-46f2-89e4-51a3c1c80f70 tempest-AttachVolumeTestJSON-207544691 None] Created volume successfully. Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "cinder-9b42bae9-76c9-48eb-a462-baa1d212cc83-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-9b42bae9-76c9-48eb-a462-baa1d212cc83-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "cinder-quobyte-9b42bae9-76c9-48eb-a462-baa1d212cc83" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-9b42bae9-76c9-48eb-a462-baa1d212cc83" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[62646740-e60d-45ac-b9e6-268c86d3b763]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9b42bae9-76c9-48eb-a462-baa1d212cc83 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:41 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9b42bae9-76c9-48eb-a462-baa1d212cc83 Jul 21 19:04:41 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:41 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9b42bae9-76c9-48eb-a462-baa1d212cc83" returned: 0 in 0.389s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9b42bae9-76c9-48eb-a462-baa1d212cc83 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:41 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9b42bae9-76c9-48eb-a462-baa1d212cc83 Jul 21 19:04:41 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:42 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9b42bae9-76c9-48eb-a462-baa1d212cc83" returned: 0 in 0.306s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-quobyte-9b42bae9-76c9-48eb-a462-baa1d212cc83" released by "delete_volume" :: held 0.748s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:42 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] Created reservations ['641f4432-2278-4735-a79f-fc3c84b7f5c7', '5f4a39d1-d3e9-43de-8f23-173147015390', 'f06271af-57dd-4393-8de1-be576641cb6b', 'f37bb15c-3542-4abd-9ae6-0af9913a848e'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:04:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:42 devstack sudo[94076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:04:42 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:42 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.366s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:42 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:04:42 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] Deleted volume successfully. Jul 21 19:04:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7d5a1b73-950c-4dfb-a09e-e04fa2e7228d tempest-VolumesDeleteCascade-1115585104 None] Lock "cinder-9b42bae9-76c9-48eb-a462-baa1d212cc83-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:04:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-5deac9fb-5496-4cea-985c-e1c94247160f req-93288766-aa6d-4961-8770-b7969d016917 tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-5deac9fb-5496-4cea-985c-e1c94247160f req-93288766-aa6d-4961-8770-b7969d016917 tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-5deac9fb-5496-4cea-985c-e1c94247160f req-93288766-aa6d-4961-8770-b7969d016917 tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-5deac9fb-5496-4cea-985c-e1c94247160f req-93288766-aa6d-4961-8770-b7969d016917 tempest-AttachVolumeTestJSON-207544691 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-00623b93-7de5-4d53-937a-3dedf9904092', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c86a509-0435-488d-ab64-56c329828f4f', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:04:43 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-5deac9fb-5496-4cea-985c-e1c94247160f req-93288766-aa6d-4961-8770-b7969d016917 tempest-AttachVolumeTestJSON-207544691 None] attachment_update completed successfully. Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Flow 'volume_create_manager' (e974d11f-b401-4e81-8530-5f0b5f3bd159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e58ac5-d7d9-484d-82f3-f42b2e336f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e58ac5-d7d9-484d-82f3-f42b2e336f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1784082328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc5d677-6d2c-4a7f-9039-d23906409aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f685c31f5d5548efb040c823517d2d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:46Z,use_quota=True,user_id='19b5d82e32ac4b4985d9977399f80c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e65d96-1a6b-4dc2-be22-5c87384b9dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e65d96-1a6b-4dc2-be22-5c87384b9dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2dfc44-3873-4a36-a73a-1cdbc87f7cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2dfc44-3873-4a36-a73a-1cdbc87f7cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fc5d677-6d2c-4a7f-9039-d23906409aa5', 'volume_name': 'volume-2fc5d677-6d2c-4a7f-9039-d23906409aa5', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c207c1c-1510-41ea-a234-09e979983364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c207c1c-1510-41ea-a234-09e979983364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7e0519-e6c6-4021-87f9-697a5951f185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:46 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Volume 2fc5d677-6d2c-4a7f-9039-d23906409aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fc5d677-6d2c-4a7f-9039-d23906409aa5', 'volume_size': 1} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1784082328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc5d677-6d2c-4a7f-9039-d23906409aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f685c31f5d5548efb040c823517d2d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:46Z,use_quota=True,user_id='19b5d82e32ac4b4985d9977399f80c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Creating volume 2fc5d677-6d2c-4a7f-9039-d23906409aa5 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:04:46 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2fc5d677-6d2c-4a7f-9039-d23906409aa5 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:46 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2fc5d677-6d2c-4a7f-9039-d23906409aa5 1073741824 Jul 21 19:04:46 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Flow 'volume_create_manager' (40c63da0-cd65-4adb-8b78-c7eed0ebe344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11670282-074e-4f40-8c4d-a924ccabc362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11670282-074e-4f40-8c4d-a924ccabc362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1962150934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71134fce-aa52-4ec6-a298-105851cf8c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa86265c67a46cb942aee8791570e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:47Z,use_quota=True,user_id='16fa2aa4ab944306862fa2c308f5d1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb116da-6cb7-430a-9c1b-f6bf6b29e569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb116da-6cb7-430a-9c1b-f6bf6b29e569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fa2964-4975-4cdf-ac24-d3484ed9c21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fa2964-4975-4cdf-ac24-d3484ed9c21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71134fce-aa52-4ec6-a298-105851cf8c04', 'volume_name': 'volume-71134fce-aa52-4ec6-a298-105851cf8c04', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05aef729-cb32-43f9-9a57-ef33c04bf00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05aef729-cb32-43f9-9a57-ef33c04bf00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acb3bf3-0043-4a66-b62c-7fc9cb071b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:46 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Volume 71134fce-aa52-4ec6-a298-105851cf8c04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71134fce-aa52-4ec6-a298-105851cf8c04', 'volume_size': 1} Jul 21 19:04:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:47 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2fc5d677-6d2c-4a7f-9039-d23906409aa5 1073741824" returned: 0 in 0.702s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2fc5d677-6d2c-4a7f-9039-d23906409aa5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:47 devstack sudo[94124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2fc5d677-6d2c-4a7f-9039-d23906409aa5 Jul 21 19:04:47 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:47 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2fc5d677-6d2c-4a7f-9039-d23906409aa5" returned: 0 in 0.338s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.676s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1962150934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71134fce-aa52-4ec6-a298-105851cf8c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa86265c67a46cb942aee8791570e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:47Z,use_quota=True,user_id='16fa2aa4ab944306862fa2c308f5d1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Creating volume 71134fce-aa52-4ec6-a298-105851cf8c04 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:04:47 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7e0519-e6c6-4021-87f9-697a5951f185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fc5d677-6d2c-4a7f-9039-d23906409aa5', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:47 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 1073741824 Jul 21 19:04:47 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d0287e-8010-44ff-9e7c-1ebf8fa67f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:47 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Volume volume-2fc5d677-6d2c-4a7f-9039-d23906409aa5 (2fc5d677-6d2c-4a7f-9039-d23906409aa5): created successfully Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d0287e-8010-44ff-9e7c-1ebf8fa67f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Flow 'volume_create_manager' (e974d11f-b401-4e81-8530-5f0b5f3bd159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:47 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-ca48d91d-e5f6-48a9-a471-6ffa4184b099 tempest-AttachVolumeTestJSON-207544691 None] Created volume successfully. Jul 21 19:04:48 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 1073741824" returned: 0 in 0.669s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:48 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 Jul 21 19:04:48 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:48 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04" returned: 0 in 0.439s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:04:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acb3bf3-0043-4a66-b62c-7fc9cb071b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71134fce-aa52-4ec6-a298-105851cf8c04', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4d506d-cbf5-4f9e-b634-91dcfbc5d9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:48 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Volume volume-71134fce-aa52-4ec6-a298-105851cf8c04 (71134fce-aa52-4ec6-a298-105851cf8c04): created successfully Jul 21 19:04:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4d506d-cbf5-4f9e-b634-91dcfbc5d9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Flow 'volume_create_manager' (40c63da0-cd65-4adb-8b78-c7eed0ebe344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:48 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-e8150945-e913-4763-8c8d-07b681abd8e7 tempest-VolumesCloneTest-1264789873 None] Created volume successfully. Jul 21 19:04:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-755cf348-bd54-421c-973b-3f39ae867251 req-dd5395b0-4e29-4b0c-95c0-32fa135cad46 tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-755cf348-bd54-421c-973b-3f39ae867251 req-dd5395b0-4e29-4b0c-95c0-32fa135cad46 tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-755cf348-bd54-421c-973b-3f39ae867251 req-dd5395b0-4e29-4b0c-95c0-32fa135cad46 tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-755cf348-bd54-421c-973b-3f39ae867251 req-dd5395b0-4e29-4b0c-95c0-32fa135cad46 tempest-AttachVolumeTestJSON-207544691 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-2fc5d677-6d2c-4a7f-9039-d23906409aa5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '136abbb6-f914-4e4c-baa9-2177cb72d355', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:04:49 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=77,cinder:UPDATE=75,cinder:INSERT=17 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:04:49 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=69,cinder:UPDATE=76,cinder:INSERT=19,cinder:DELETE=14 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:04:49 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-755cf348-bd54-421c-973b-3f39ae867251 req-dd5395b0-4e29-4b0c-95c0-32fa135cad46 tempest-AttachVolumeTestJSON-207544691 None] attachment_update completed successfully. Jul 21 19:04:50 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:04:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Flow 'volume_create_manager' (43cfbf62-42e7-45fe-89d7-b33fa7c28f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:04:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03e6221-2801-4103-83b1-12e15612744e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03e6221-2801-4103-83b1-12e15612744e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-139671201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03206cca-1035-4a27-a8f5-2c2fba2f87b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa86265c67a46cb942aee8791570e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:04:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=71134fce-aa52-4ec6-a298-105851cf8c04,status='creating',terminated_at=None,updated_at=2026-07-21T17:04:51Z,use_quota=True,user_id='16fa2aa4ab944306862fa2c308f5d1c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853e2d31-5b1b-4696-a2d5-857aeb4abeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853e2d31-5b1b-4696-a2d5-857aeb4abeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (365b3f8d-600e-4996-8fc5-4a5713d1949c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (365b3f8d-600e-4996-8fc5-4a5713d1949c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '03206cca-1035-4a27-a8f5-2c2fba2f87b5', 'volume_name': 'volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5', 'volume_size': 2, 'source_volid': '71134fce-aa52-4ec6-a298-105851cf8c04', 'source_volstatus': 'available'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc83c6e9-7a66-4127-93c0-46c3a23d34e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc83c6e9-7a66-4127-93c0-46c3a23d34e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:04:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6453b924-2d96-4514-b8eb-a8b1d96de6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:04:51 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Volume 03206cca-1035-4a27-a8f5-2c2fba2f87b5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5', 'volume_size': 2, 'source_volid': '71134fce-aa52-4ec6-a298-105851cf8c04', 'source_volstatus': 'available'} Jul 21 19:04:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:51 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Cloning volume 71134fce-aa52-4ec6-a298-105851cf8c04 to volume 03206cca-1035-4a27-a8f5-2c2fba2f87b5 Jul 21 19:04:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Creating offline snapshot a3fd08ff-896e-4605-9cec-d726e00e1004 of volume 71134fce-aa52-4ec6-a298-105851cf8c04 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:04:51 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a3920b-b983-4cb4-9554-a5c852d64f91]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:51 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 Jul 21 19:04:51 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:51 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04" returned: 0 in 0.659s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:51 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004 1G Jul 21 19:04:51 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:52 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004 1G" returned: 0 in 0.715s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71134fce-aa52-4ec6-a298-105851cf8c04 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:52 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71134fce-aa52-4ec6-a298-105851cf8c04 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004 Jul 21 19:04:52 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:52 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-c13443b1-66cc-471d-aa4d-f4d6949f1fd6 req-1ec6347d-af1c-4cb9-a433-99655af3c23d tempest-AttachVolumeTestJSON-207544691 None] Terminate volume connection completed successfully. Jul 21 19:04:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-c13443b1-66cc-471d-aa4d-f4d6949f1fd6 req-1ec6347d-af1c-4cb9-a433-99655af3c23d tempest-AttachVolumeTestJSON-207544691 None] Deleting attachment 2c86a509-0435-488d-ab64-56c329828f4f. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:04:53 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71134fce-aa52-4ec6-a298-105851cf8c04 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004" returned: 0 in 0.379s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:53 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004 is being set with open permissions: ugo+rw Jul 21 19:04:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:53 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004 Jul 21 19:04:53 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:53 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004" returned: 0 in 0.327s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:53 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.info Jul 21 19:04:53 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:53 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.info" returned: 0 in 0.277s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:53 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.info is being set with open permissions: ugo+rw Jul 21 19:04:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:53 devstack sudo[94214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.info Jul 21 19:04:53 devstack sudo[94214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:54 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-592bdcf7-c7fb-4bfe-b97d-e8652d2b81ac req-7224713d-58f7-4bec-8873-66963154d017 tempest-AttachVolumeNegativeTest-1325674848 None] Terminate volume connection completed successfully. Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-592bdcf7-c7fb-4bfe-b97d-e8652d2b81ac req-7224713d-58f7-4bec-8873-66963154d017 tempest-AttachVolumeNegativeTest-1325674848 None] Deleting attachment 60239ad0-2f2c-463c-8c0c-1dc6aaeed8d4. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:04:54 devstack sudo[94214]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.info" returned: 0 in 0.389s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Acquiring lock "cinder-quobyte-03206cca-1035-4a27-a8f5-2c2fba2f87b5" by "_copy_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Lock "cinder-quobyte-03206cca-1035-4a27-a8f5-2c2fba2f87b5" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] snapshot: a3fd08ff-896e-4605-9cec-d726e00e1004, volume: 03206cca-1035-4a27-a8f5-2c2fba2f87b5, {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3499d6-4851-46e7-ba9d-76c31284e8ea]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:54 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004 Jul 21 19:04:54 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:54 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-736e56bb-dbf5-4a98-a96e-6b62c98b9eb9 req-6765a179-e054-40c9-b813-218480607a8e tempest-AttachVolumeTestJSON-207544691 None] Terminate volume connection completed successfully. Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-736e56bb-dbf5-4a98-a96e-6b62c98b9eb9 req-6765a179-e054-40c9-b813-218480607a8e tempest-AttachVolumeTestJSON-207544691 None] Deleting attachment 136abbb6-f914-4e4c-baa9-2177cb72d355. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:04:54 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004" returned: 0 in 0.502s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71134fce-aa52-4ec6-a298-105851cf8c04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Creating direct copy from snapshot {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b62cca0-7183-4e9b-a7c2-1fb2e0a53112]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:04:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:54 devstack sudo[94229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 Jul 21 19:04:54 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:55 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04" returned: 0 in 0.537s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:55 devstack cinder-volume[87570]: DEBUG cinder.utils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Path /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5 not found in is_blk_device check {{(pid=87570) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:04:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:55 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5 Jul 21 19:04:55 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:04:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:56 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:04:56 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:57 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.948s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:04:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:04:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:04:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:05:02 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5" returned: 0 in 6.768s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:02 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d3d6ec-196b-41ab-92cd-6e308b6194fb]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:02 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 Jul 21 19:05:02 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:02 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04" returned: 0 in 0.807s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:02 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Image conversion details: src /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04, size 1024.00 MB, duration 6.78 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5 {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:05:02 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Converted 1024.00 MB image at 150.95 MB/s Jul 21 19:05:02 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5 is being set with open permissions: ugo+rw Jul 21 19:05:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:02 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5 Jul 21 19:05:02 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:03 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5" returned: 0 in 0.415s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Lock "cinder-quobyte-03206cca-1035-4a27-a8f5-2c2fba2f87b5" released by "_copy_volume_from_snapshot" :: held 9.206s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Acquiring lock "cinder-quobyte-a3fd08ff-896e-4605-9cec-d726e00e1004" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Lock "cinder-quobyte-a3fd08ff-896e-4605-9cec-d726e00e1004" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Deleting offline snapshot a3fd08ff-896e-4605-9cec-d726e00e1004 of volume 71134fce-aa52-4ec6-a298-105851cf8c04 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:05:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] snapshot_file for this snap is: volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:05:03 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d5b0cd-ecc8-4780-8a86-e3823adb6de1]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:03 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004 Jul 21 19:05:03 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:03 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004" returned: 0 in 0.447s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71134fce-aa52-4ec6-a298-105851cf8c04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:03 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc98606-393a-4568-af96-b5967ea5299c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:04 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 Jul 21 19:05:04 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "cinder-2fc5d677-6d2c-4a7f-9039-d23906409aa5-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] Lock "cinder-2fc5d677-6d2c-4a7f-9039-d23906409aa5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "cinder-quobyte-2fc5d677-6d2c-4a7f-9039-d23906409aa5" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] Lock "cinder-quobyte-2fc5d677-6d2c-4a7f-9039-d23906409aa5" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:04 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af441c8-c50b-4556-8a8a-e1da913d146f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2fc5d677-6d2c-4a7f-9039-d23906409aa5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:04 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04" returned: 0 in 0.629s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:04 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2fc5d677-6d2c-4a7f-9039-d23906409aa5 Jul 21 19:05:04 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:04 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004 Jul 21 19:05:04 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:04 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2fc5d677-6d2c-4a7f-9039-d23906409aa5" returned: 0 in 0.540s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2fc5d677-6d2c-4a7f-9039-d23906409aa5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:05 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2fc5d677-6d2c-4a7f-9039-d23906409aa5 Jul 21 19:05:05 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:05 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004" returned: 0 in 0.574s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:05 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004 Jul 21 19:05:05 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:05 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2fc5d677-6d2c-4a7f-9039-d23906409aa5" returned: 0 in 0.381s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] Lock "cinder-quobyte-2fc5d677-6d2c-4a7f-9039-d23906409aa5" released by "delete_volume" :: held 1.005s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] Created reservations ['79132012-416a-4a4c-b16a-59293fe1a73f', '205289dc-7fa3-4687-92d6-de10a3ef75e4', '006fef7e-393f-40f7-8948-ea04e788ef5a', '2cec102f-ecf4-4478-bbef-2c6d7a46d4bd'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:05 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:05:05 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:05 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04.a3fd08ff-896e-4605-9cec-d726e00e1004" returned: 0 in 0.510s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Lock "cinder-quobyte-a3fd08ff-896e-4605-9cec-d726e00e1004" released by "_delete_snapshot" :: held 2.309s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.566s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6453b924-2d96-4514-b8eb-a8b1d96de6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5', 'volume_size': 2, 'source_volid': '71134fce-aa52-4ec6-a298-105851cf8c04', 'source_volstatus': 'available'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193e904d-1446-4fe5-9f8b-108666072cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:05 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Volume volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5 (03206cca-1035-4a27-a8f5-2c2fba2f87b5): created successfully Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193e904d-1446-4fe5-9f8b-108666072cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Flow 'volume_create_manager' (43cfbf62-42e7-45fe-89d7-b33fa7c28f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:05 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-262583e2-dd5b-4320-95ab-cacd9510d62b tempest-VolumesCloneTest-1264789873 None] Created volume successfully. Jul 21 19:05:05 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.337s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:05 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:05 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] Deleted volume successfully. Jul 21 19:05:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-eb039f84-b8a0-4175-a229-ef719984916d tempest-AttachVolumeTestJSON-207544691 None] Lock "cinder-2fc5d677-6d2c-4a7f-9039-d23906409aa5-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] Acquiring lock "cinder-03206cca-1035-4a27-a8f5-2c2fba2f87b5-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] Lock "cinder-03206cca-1035-4a27-a8f5-2c2fba2f87b5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] Acquiring lock "cinder-quobyte-03206cca-1035-4a27-a8f5-2c2fba2f87b5" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] Lock "cinder-quobyte-03206cca-1035-4a27-a8f5-2c2fba2f87b5" acquired by "delete_volume" :: waited 0.028s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:06 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2caca8c-e1ed-4ce2-bc4e-c29a8d79cafd]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:06 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5 Jul 21 19:05:06 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "cinder-00623b93-7de5-4d53-937a-3dedf9904092-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] Lock "cinder-00623b93-7de5-4d53-937a-3dedf9904092-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "cinder-quobyte-00623b93-7de5-4d53-937a-3dedf9904092" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] Lock "cinder-quobyte-00623b93-7de5-4d53-937a-3dedf9904092" acquired by "delete_volume" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:06 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5" returned: 0 in 0.459s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:06 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[d296dda1-0ce3-461a-8431-0e1c2b386d89]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-00623b93-7de5-4d53-937a-3dedf9904092 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:06 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5 Jul 21 19:05:06 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:06 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-00623b93-7de5-4d53-937a-3dedf9904092 Jul 21 19:05:06 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:07 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-03206cca-1035-4a27-a8f5-2c2fba2f87b5" returned: 0 in 0.310s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] Lock "cinder-quobyte-03206cca-1035-4a27-a8f5-2c2fba2f87b5" released by "delete_volume" :: held 0.820s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] Created reservations ['e0c35665-f386-4323-8464-5362c30eb1e7', 'fd94cda1-d3e9-42eb-972d-b1872e6e2ee8', '8445b309-a41d-4a4f-a6f4-f489c3eb95e6', '3c76aef4-1ca0-49f5-aee3-aae09d6a6f9d'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:07 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:05:07 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:07 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-00623b93-7de5-4d53-937a-3dedf9904092" returned: 0 in 0.595s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-00623b93-7de5-4d53-937a-3dedf9904092 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:07 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-00623b93-7de5-4d53-937a-3dedf9904092 Jul 21 19:05:07 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] Acquiring lock "cinder-71134fce-aa52-4ec6-a298-105851cf8c04-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] Lock "cinder-71134fce-aa52-4ec6-a298-105851cf8c04-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:07 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] Acquiring lock "cinder-quobyte-71134fce-aa52-4ec6-a298-105851cf8c04" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.401s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:07 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] Deleted volume successfully. Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] Lock "cinder-quobyte-71134fce-aa52-4ec6-a298-105851cf8c04" acquired by "delete_volume" :: waited 0.044s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21f80a3a-cbc0-45c5-bf77-6912ae85a9f5 tempest-VolumesCloneTest-1264789873 None] Lock "cinder-03206cca-1035-4a27-a8f5-2c2fba2f87b5-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b6e6ea-7e51-4377-925e-ad7a79acf4ce]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:07 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-00623b93-7de5-4d53-937a-3dedf9904092" returned: 0 in 0.473s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] Lock "cinder-quobyte-00623b93-7de5-4d53-937a-3dedf9904092" released by "delete_volume" :: held 1.135s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:07 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] Created reservations ['3bd61dd5-6f7a-407c-8251-588a71359b51', '4d78bf60-a912-4128-86ef-135b205b02d4', 'cc2f13f6-4e63-4929-859b-cf00d4c6ef5f', '2e0ac221-688d-4006-bf45-3a53738dd9b5'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:07 devstack sudo[94387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 Jul 21 19:05:07 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:08 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:05:08 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:08 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04" returned: 0 in 0.515s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:08 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04 Jul 21 19:05:08 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:08 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.340s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:08 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:08 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] Deleted volume successfully. Jul 21 19:05:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-caf6cf1b-4bd5-40fb-830e-140d2855805f tempest-AttachVolumeTestJSON-207544691 None] Lock "cinder-00623b93-7de5-4d53-937a-3dedf9904092-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:08 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-71134fce-aa52-4ec6-a298-105851cf8c04" returned: 0 in 0.385s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] Lock "cinder-quobyte-71134fce-aa52-4ec6-a298-105851cf8c04" released by "delete_volume" :: held 1.041s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:08 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] Created reservations ['592f069e-d16e-44f3-b4e6-601e85ca9059', 'ec7d01a5-2f1e-4900-add4-48c5cbe78860', 'c620daba-199e-467c-bbe1-0c26157dad03', 'e3d58eb5-fc5c-4aff-8ddc-5fa7107c7bd8'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:09 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:05:09 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "cinder-f7a64dca-5b27-494c-9e41-3958362f1a46-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] Lock "cinder-f7a64dca-5b27-494c-9e41-3958362f1a46-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "cinder-quobyte-f7a64dca-5b27-494c-9e41-3958362f1a46" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] Lock "cinder-quobyte-f7a64dca-5b27-494c-9e41-3958362f1a46" acquired by "delete_volume" :: waited 0.036s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:09 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f11545-1c20-4b25-ba85-d0cb7b76eae5]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f7a64dca-5b27-494c-9e41-3958362f1a46 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:09 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.518s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:09 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:09 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] Deleted volume successfully. Jul 21 19:05:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-17abf320-03c2-4181-90f7-7a57fe9cc2c2 tempest-VolumesCloneTest-1264789873 None] Lock "cinder-71134fce-aa52-4ec6-a298-105851cf8c04-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:09 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f7a64dca-5b27-494c-9e41-3958362f1a46 Jul 21 19:05:09 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:10 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f7a64dca-5b27-494c-9e41-3958362f1a46" returned: 0 in 0.950s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f7a64dca-5b27-494c-9e41-3958362f1a46 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:10 devstack sudo[94483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f7a64dca-5b27-494c-9e41-3958362f1a46 Jul 21 19:05:10 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:11 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f7a64dca-5b27-494c-9e41-3958362f1a46" returned: 0 in 0.622s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] Lock "cinder-quobyte-f7a64dca-5b27-494c-9e41-3958362f1a46" released by "delete_volume" :: held 1.685s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:11 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] Created reservations ['59652c7f-d9e3-42ba-b417-dfaf72017a38', '941fab25-1777-4523-b468-e2a83b8f48ba', 'e4bee839-6c12-4079-b843-e715a06e84df', 'd9ae6194-077d-482d-96dd-d4c24511c9a7'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:11 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:05:11 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:12 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.554s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:12 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:12 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] Deleted volume successfully. Jul 21 19:05:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fab057d9-9770-47f6-8535-5be40571cc0c tempest-AttachVolumeTestJSON-207544691 None] Lock "cinder-f7a64dca-5b27-494c-9e41-3958362f1a46-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Flow 'volume_create_manager' (e07f5353-cd7b-461c-ab7e-a845f2b537a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6e77c0-332c-4c11-a8b1-73b3cd66eba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6e77c0-332c-4c11-a8b1-73b3cd66eba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1891690777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b493c9e-ce56-4157-80e9-25d390b484ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac6454ccbd284a89baee3b4266d4f350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:16Z,use_quota=True,user_id='b64d296b42d84e06bdcb20d3acfdd10b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be993fb-2862-40ae-8422-5220629f5dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be993fb-2862-40ae-8422-5220629f5dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdde93c7-618b-4792-aa90-830239786c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdde93c7-618b-4792-aa90-830239786c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b493c9e-ce56-4157-80e9-25d390b484ae', 'volume_name': 'volume-1b493c9e-ce56-4157-80e9-25d390b484ae', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1361f983-7d7a-4e1d-a5e9-d47bd8cab10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1361f983-7d7a-4e1d-a5e9-d47bd8cab10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcca4725-93f0-4f7a-a4c9-52c6cfd6e5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:16 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Volume 1b493c9e-ce56-4157-80e9-25d390b484ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b493c9e-ce56-4157-80e9-25d390b484ae', 'volume_size': 1} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1891690777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b493c9e-ce56-4157-80e9-25d390b484ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac6454ccbd284a89baee3b4266d4f350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:16Z,use_quota=True,user_id='b64d296b42d84e06bdcb20d3acfdd10b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Creating volume 1b493c9e-ce56-4157-80e9-25d390b484ae {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:05:16 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:05:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1b493c9e-ce56-4157-80e9-25d390b484ae 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:16 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1b493c9e-ce56-4157-80e9-25d390b484ae 1073741824 Jul 21 19:05:16 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:17 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1b493c9e-ce56-4157-80e9-25d390b484ae 1073741824" returned: 0 in 1.407s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1b493c9e-ce56-4157-80e9-25d390b484ae {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:18 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1b493c9e-ce56-4157-80e9-25d390b484ae Jul 21 19:05:18 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:18 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1b493c9e-ce56-4157-80e9-25d390b484ae" returned: 0 in 0.685s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:05:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcca4725-93f0-4f7a-a4c9-52c6cfd6e5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b493c9e-ce56-4157-80e9-25d390b484ae', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca45163c-f6bd-4621-88be-8df8913eb212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:18 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Volume volume-1b493c9e-ce56-4157-80e9-25d390b484ae (1b493c9e-ce56-4157-80e9-25d390b484ae): created successfully Jul 21 19:05:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca45163c-f6bd-4621-88be-8df8913eb212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Flow 'volume_create_manager' (e07f5353-cd7b-461c-ab7e-a845f2b537a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:18 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-085ac431-e64e-4d13-a3bf-66792cad4c93 tempest-VolumesListTestJSON-1688524846 None] Created volume successfully. Jul 21 19:05:20 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:05:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Flow 'volume_create_manager' (ae4d9ec4-4304-4906-a7da-7109c99185bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901cee5d-fa84-4ddd-94d5-9c72ab3e9cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901cee5d-fa84-4ddd-94d5-9c72ab3e9cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-212897303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0046deb5-4578-43b0-8f9c-5c7ce7813c5d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac6454ccbd284a89baee3b4266d4f350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:21Z,use_quota=True,user_id='b64d296b42d84e06bdcb20d3acfdd10b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8509fd-d311-47c8-a02c-b84dfffb0cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8509fd-d311-47c8-a02c-b84dfffb0cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d8ed91-c902-495a-a758-eb4c4aff234a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d8ed91-c902-495a-a758-eb4c4aff234a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0046deb5-4578-43b0-8f9c-5c7ce7813c5d', 'volume_name': 'volume-0046deb5-4578-43b0-8f9c-5c7ce7813c5d', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1400b8-f509-4714-b85d-e918c72c9ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1400b8-f509-4714-b85d-e918c72c9ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43ba81a-3ba2-4d4e-981a-e04404ec9553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:21 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Volume 0046deb5-4578-43b0-8f9c-5c7ce7813c5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0046deb5-4578-43b0-8f9c-5c7ce7813c5d', 'volume_size': 1} Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-212897303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0046deb5-4578-43b0-8f9c-5c7ce7813c5d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac6454ccbd284a89baee3b4266d4f350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:21Z,use_quota=True,user_id='b64d296b42d84e06bdcb20d3acfdd10b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Creating volume 0046deb5-4578-43b0-8f9c-5c7ce7813c5d {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:05:21 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:05:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0046deb5-4578-43b0-8f9c-5c7ce7813c5d 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:21 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0046deb5-4578-43b0-8f9c-5c7ce7813c5d 1073741824 Jul 21 19:05:21 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:22 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0046deb5-4578-43b0-8f9c-5c7ce7813c5d 1073741824" returned: 0 in 1.114s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0046deb5-4578-43b0-8f9c-5c7ce7813c5d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:22 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0046deb5-4578-43b0-8f9c-5c7ce7813c5d Jul 21 19:05:22 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:22 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0046deb5-4578-43b0-8f9c-5c7ce7813c5d" returned: 0 in 0.424s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:05:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43ba81a-3ba2-4d4e-981a-e04404ec9553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0046deb5-4578-43b0-8f9c-5c7ce7813c5d', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c63c79-9505-413e-a7f7-7bdbb738795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:22 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Volume volume-0046deb5-4578-43b0-8f9c-5c7ce7813c5d (0046deb5-4578-43b0-8f9c-5c7ce7813c5d): created successfully Jul 21 19:05:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c63c79-9505-413e-a7f7-7bdbb738795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Flow 'volume_create_manager' (ae4d9ec4-4304-4906-a7da-7109c99185bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:22 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-74241800-3b47-4f65-bd02-b0d66d2d8ab8 tempest-VolumesListTestJSON-1688524846 None] Created volume successfully. Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Flow 'volume_create_manager' (e5caf158-e46e-45ca-9e6d-cfc96a17cd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ed0247-a859-4951-be3e-189ce2befe7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ed0247-a859-4951-be3e-189ce2befe7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-238462360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acfba6dd-7c75-49d6-8d2f-572d468ec15b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac6454ccbd284a89baee3b4266d4f350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:25Z,use_quota=True,user_id='b64d296b42d84e06bdcb20d3acfdd10b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2f946f-754c-43eb-85ef-72eab3af0932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2f946f-754c-43eb-85ef-72eab3af0932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d6d8ac-9eb0-4899-9845-65a5c1483c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d6d8ac-9eb0-4899-9845-65a5c1483c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acfba6dd-7c75-49d6-8d2f-572d468ec15b', 'volume_name': 'volume-acfba6dd-7c75-49d6-8d2f-572d468ec15b', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4718da7d-bc46-4c66-a5ae-055272c1ab18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4718da7d-bc46-4c66-a5ae-055272c1ab18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a5986a-16ff-4308-8160-be618b37bc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:24 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Volume acfba6dd-7c75-49d6-8d2f-572d468ec15b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acfba6dd-7c75-49d6-8d2f-572d468ec15b', 'volume_size': 1} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-238462360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acfba6dd-7c75-49d6-8d2f-572d468ec15b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac6454ccbd284a89baee3b4266d4f350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:25Z,use_quota=True,user_id='b64d296b42d84e06bdcb20d3acfdd10b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Creating volume acfba6dd-7c75-49d6-8d2f-572d468ec15b {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:05:24 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:05:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acfba6dd-7c75-49d6-8d2f-572d468ec15b 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:25 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acfba6dd-7c75-49d6-8d2f-572d468ec15b 1073741824 Jul 21 19:05:25 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:25 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acfba6dd-7c75-49d6-8d2f-572d468ec15b 1073741824" returned: 0 in 0.544s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acfba6dd-7c75-49d6-8d2f-572d468ec15b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:25 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acfba6dd-7c75-49d6-8d2f-572d468ec15b Jul 21 19:05:25 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Flow 'volume_create_manager' (b535261f-b7df-4bb1-a258-a05b8c189f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0deccfb9-e22e-4a44-a1c1-b90a7a1b7dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0deccfb9-e22e-4a44-a1c1-b90a7a1b7dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-86398401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbd72e1-e9c0-46bf-8a86-2f562b9d2340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5334f5415044784b9416d677c31c8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:26Z,use_quota=True,user_id='ba1aeb17eaad47a3aaee9cf9247b6d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1836ac1-5ef5-44e4-9434-af9571bc993b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1836ac1-5ef5-44e4-9434-af9571bc993b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d27d9c6-5fa2-40f5-a767-8d57f68c905c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d27d9c6-5fa2-40f5-a767-8d57f68c905c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdbd72e1-e9c0-46bf-8a86-2f562b9d2340', 'volume_name': 'volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f429fee3-b4e1-4b98-be0c-638b7ea84997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f429fee3-b4e1-4b98-be0c-638b7ea84997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6daae70b-e3e1-4e9e-bd98-0de23620b72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:25 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Volume bdbd72e1-e9c0-46bf-8a86-2f562b9d2340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340', 'volume_size': 1} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:25 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acfba6dd-7c75-49d6-8d2f-572d468ec15b" returned: 0 in 0.327s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.146s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-86398401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbd72e1-e9c0-46bf-8a86-2f562b9d2340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5334f5415044784b9416d677c31c8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:26Z,use_quota=True,user_id='ba1aeb17eaad47a3aaee9cf9247b6d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Creating volume bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:05:25 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a5986a-16ff-4308-8160-be618b37bc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acfba6dd-7c75-49d6-8d2f-572d468ec15b', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:25 devstack sudo[94661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 1073741824 Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8160504c-657f-435f-98ce-3e1005272777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:25 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:25 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Volume volume-acfba6dd-7c75-49d6-8d2f-572d468ec15b (acfba6dd-7c75-49d6-8d2f-572d468ec15b): created successfully Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8160504c-657f-435f-98ce-3e1005272777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Flow 'volume_create_manager' (e5caf158-e46e-45ca-9e6d-cfc96a17cd23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:26 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-ddb9beae-18f4-4f31-95fc-c6c71e15767c tempest-VolumesListTestJSON-1688524846 None] Created volume successfully. Jul 21 19:05:26 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 1073741824" returned: 0 in 0.449s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:26 devstack sudo[94666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 Jul 21 19:05:26 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:26 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340" returned: 0 in 0.264s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:05:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6daae70b-e3e1-4e9e-bd98-0de23620b72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e3a9e10-d1ad-4dda-9705-3a5fb8e329d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:26 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Volume volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 (bdbd72e1-e9c0-46bf-8a86-2f562b9d2340): created successfully Jul 21 19:05:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e3a9e10-d1ad-4dda-9705-3a5fb8e329d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Flow 'volume_create_manager' (b535261f-b7df-4bb1-a258-a05b8c189f04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:26 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-fca4ba4a-80ce-404b-9ffb-7cd875d31c91 req-639bb9ab-efa1-4b11-af69-eb0aecd6df23 tempest-VolumesSnapshotsTestJSON-1054934949 None] Created volume successfully. Jul 21 19:05:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] Creating offline snapshot d3072888-090c-49c0-8ba7-b68b2e87ba80 of volume bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:05:28 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3726690-b3be-4766-a0c9-6f5e7504e022]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:28 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 Jul 21 19:05:28 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:28 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340" returned: 0 in 0.480s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:28 devstack sudo[94674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80 1G Jul 21 19:05:28 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:29 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80 1G" returned: 0 in 0.424s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:29 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80 Jul 21 19:05:29 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] Acquiring lock "cinder-acfba6dd-7c75-49d6-8d2f-572d468ec15b-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] Lock "cinder-acfba6dd-7c75-49d6-8d2f-572d468ec15b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] Acquiring lock "cinder-quobyte-acfba6dd-7c75-49d6-8d2f-572d468ec15b" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] Lock "cinder-quobyte-acfba6dd-7c75-49d6-8d2f-572d468ec15b" acquired by "delete_volume" :: waited 0.024s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:29 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2220e841-669b-46b2-8f7e-b9441e84de9a]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acfba6dd-7c75-49d6-8d2f-572d468ec15b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:29 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80" returned: 0 in 0.381s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:29 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80 is being set with open permissions: ugo+rw Jul 21 19:05:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:29 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80 Jul 21 19:05:29 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:29 devstack sudo[94684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acfba6dd-7c75-49d6-8d2f-572d468ec15b Jul 21 19:05:29 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:29 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80" returned: 0 in 0.260s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:29 devstack sudo[94691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.info Jul 21 19:05:29 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:29 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acfba6dd-7c75-49d6-8d2f-572d468ec15b" returned: 0 in 0.385s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acfba6dd-7c75-49d6-8d2f-572d468ec15b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:29 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acfba6dd-7c75-49d6-8d2f-572d468ec15b Jul 21 19:05:29 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:30 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.info" returned: 0 in 0.277s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:30 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.info is being set with open permissions: ugo+rw Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:30 devstack sudo[94698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.info Jul 21 19:05:30 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:30 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acfba6dd-7c75-49d6-8d2f-572d468ec15b" returned: 0 in 0.268s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] Lock "cinder-quobyte-acfba6dd-7c75-49d6-8d2f-572d468ec15b" released by "delete_volume" :: held 0.715s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] Created reservations ['6f4607b6-3a7f-4c8a-b103-85a5608dff98', '35ba89f0-5258-4fd9-8193-1b234348ccd3', '7be2684d-4018-409d-853b-3dd2b13b84fe', '9568226c-e1b8-4d50-b943-fda6bfec27c6'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:30 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:05:30 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:30 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.info" returned: 0 in 0.292s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:30 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-15429cb1-75ae-4acd-9b4f-48860975d6e9 req-3ace0cd2-dd33-42ed-adf5-fbfa0f47b047 tempest-VolumesSnapshotsTestJSON-1054934949 None] Create snapshot completed successfully Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] Acquiring lock "cinder-0046deb5-4578-43b0-8f9c-5c7ce7813c5d-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:30 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.341s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] Lock "cinder-0046deb5-4578-43b0-8f9c-5c7ce7813c5d-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] Acquiring lock "cinder-d3072888-090c-49c0-8ba7-b68b2e87ba80-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:30 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] Deleted volume successfully. Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "cinder-d3072888-090c-49c0-8ba7-b68b2e87ba80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] Acquiring lock "cinder-quobyte-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c7fa0384-5df2-41e8-9fc8-c0f9a7881ebe tempest-VolumesListTestJSON-1688524846 None] Lock "cinder-acfba6dd-7c75-49d6-8d2f-572d468ec15b-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] Acquiring lock "cinder-quobyte-0046deb5-4578-43b0-8f9c-5c7ce7813c5d" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "cinder-quobyte-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] Acquiring lock "cinder-quobyte-d3072888-090c-49c0-8ba7-b68b2e87ba80" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "cinder-quobyte-d3072888-090c-49c0-8ba7-b68b2e87ba80" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] Deleting offline snapshot d3072888-090c-49c0-8ba7-b68b2e87ba80 of volume bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] snapshot_file for this snap is: volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] Lock "cinder-quobyte-0046deb5-4578-43b0-8f9c-5c7ce7813c5d" acquired by "delete_volume" :: waited 0.053s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9c6607-1bdb-4f51-9fd7-381776b57cdb]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:31 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[425bd0e9-2742-4fd4-bfaa-51f742c7541c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0046deb5-4578-43b0-8f9c-5c7ce7813c5d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:31 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80 Jul 21 19:05:31 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:31 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0046deb5-4578-43b0-8f9c-5c7ce7813c5d Jul 21 19:05:31 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:31 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0046deb5-4578-43b0-8f9c-5c7ce7813c5d" returned: 0 in 0.472s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0046deb5-4578-43b0-8f9c-5c7ce7813c5d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:31 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80" returned: 0 in 0.522s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:31 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0046deb5-4578-43b0-8f9c-5c7ce7813c5d Jul 21 19:05:31 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:31 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa43db82-9b7a-4c78-9550-51f999976211]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:31 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 Jul 21 19:05:31 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:31 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0046deb5-4578-43b0-8f9c-5c7ce7813c5d" returned: 0 in 0.283s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:31 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] Lock "cinder-quobyte-0046deb5-4578-43b0-8f9c-5c7ce7813c5d" released by "delete_volume" :: held 0.832s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:31 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] Created reservations ['60e2029a-0036-4159-bf1c-6e1ac85960f4', '726d8995-7904-4cca-8566-fc8f3351eaed', 'dfcefebe-23b5-4ad5-9a25-1544019034ce', '1719166e-0dcb-4cca-b541-51f63cbfc8d1'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:32 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:05:32 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] Acquiring lock "cinder-1b493c9e-ce56-4157-80e9-25d390b484ae-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:32 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340" returned: 0 in 0.601s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] Lock "cinder-1b493c9e-ce56-4157-80e9-25d390b484ae-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:32 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80 Jul 21 19:05:32 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] Acquiring lock "cinder-quobyte-1b493c9e-ce56-4157-80e9-25d390b484ae" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] Lock "cinder-quobyte-1b493c9e-ce56-4157-80e9-25d390b484ae" acquired by "delete_volume" :: waited 0.048s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:32 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f09373-4561-4671-8cef-77d0e11f8a7e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1b493c9e-ce56-4157-80e9-25d390b484ae {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:32 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.457s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:32 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:32 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] Deleted volume successfully. Jul 21 19:05:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8bc2187-92ef-4e08-a6ea-d6c19cf820ff tempest-VolumesListTestJSON-1688524846 None] Lock "cinder-0046deb5-4578-43b0-8f9c-5c7ce7813c5d-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:32 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1b493c9e-ce56-4157-80e9-25d390b484ae Jul 21 19:05:32 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:32 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80" returned: 0 in 0.571s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:32 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80 Jul 21 19:05:32 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:32 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1b493c9e-ce56-4157-80e9-25d390b484ae" returned: 0 in 0.542s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1b493c9e-ce56-4157-80e9-25d390b484ae {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:32 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1b493c9e-ce56-4157-80e9-25d390b484ae Jul 21 19:05:32 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:33 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340.d3072888-090c-49c0-8ba7-b68b2e87ba80" returned: 0 in 0.361s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "cinder-quobyte-d3072888-090c-49c0-8ba7-b68b2e87ba80" released by "_delete_snapshot" :: held 2.195s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "cinder-quobyte-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340" released by "delete_snapshot" :: held 2.235s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:33 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:33 devstack cinder-volume[87570]: DEBUG cinder.quota [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] Created reservations ['ad682b0e-736c-4d16-abe8-db53a75c7a2a', 'bd15ff87-e33e-4d70-ac92-ebf70e468c19', '8aee1ba5-c24b-492e-a7e0-6c10f09085a3', 'cd6b3960-8f8f-49a1-bb7a-a1c791184ba2'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1b493c9e-ce56-4157-80e9-25d390b484ae" returned: 0 in 0.336s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] Lock "cinder-quobyte-1b493c9e-ce56-4157-80e9-25d390b484ae" released by "delete_volume" :: held 0.936s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:33 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] Delete snapshot completed successfully. Jul 21 19:05:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-83bc9f5b-7ced-433a-83ab-dea781f15b62 req-bb1a7286-ec72-4b87-b5ef-78c3b20a09b9 tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "cinder-d3072888-090c-49c0-8ba7-b68b2e87ba80-delete_snapshot" released by "delete_snapshot" :: held 2.453s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:33 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] Created reservations ['43187511-6a86-4104-a73b-54e4312b3aff', '38029476-30e8-40fe-8318-9a76b6593cf3', '2563d307-c932-45c2-a38d-e8a20c68ea41', '6b1eb306-44f9-4a78-9dea-b1a33f5a56c8'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:33 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:05:33 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:33 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.238s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:33 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:33 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] Deleted volume successfully. Jul 21 19:05:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3f81713d-f478-42f8-9d9b-510d8158bb92 tempest-VolumesListTestJSON-1688524846 None] Lock "cinder-1b493c9e-ce56-4157-80e9-25d390b484ae-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] Acquiring lock "cinder-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "cinder-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] Acquiring lock "cinder-quobyte-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "cinder-quobyte-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:34 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[199b183c-b39d-4e77-bcf6-364af6504349]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:34 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 Jul 21 19:05:34 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:34 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340" returned: 0 in 0.406s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:34 devstack sudo[94786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340 Jul 21 19:05:34 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:34 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340" returned: 0 in 0.281s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "cinder-quobyte-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340" released by "delete_volume" :: held 0.765s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG cinder.quota [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] Created reservations ['2aa16426-fa9d-4d73-b815-fe446570d941', 'f3d15188-b2ac-4a9d-b534-e30413e3a153', 'e622ca87-603c-4846-b0bf-ef427ca61d45', 'be1320dd-427d-42dc-94d1-bd80b205abe6'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:35 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:05:35 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:35 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.298s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG cinder.manager [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:35 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] Deleted volume successfully. Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-6f44824b-bb10-4cfa-93bb-042424ab61b2 req-bef4be88-c451-41f2-b7ad-f8fa282ddb3a tempest-VolumesSnapshotsTestJSON-1054934949 None] Lock "cinder-bdbd72e1-e9c0-46bf-8a86-2f562b9d2340-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Flow 'volume_create_manager' (e3a559ac-937f-4f4d-a4df-fb8ddb239b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da320834-9759-4385-a618-291ac77bbf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da320834-9759-4385-a618-291ac77bbf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-194229138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b850e13c-eb92-466e-80ae-35821fa3a2df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504c6ee3adcb4bb7977b6ec0b3a607f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:36Z,use_quota=True,user_id='018982fab32248868798f75615c74de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06646881-4154-41f3-b52c-74d68a68fe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06646881-4154-41f3-b52c-74d68a68fe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aaa446b-b006-4a0d-a799-dea6bd021e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aaa446b-b006-4a0d-a799-dea6bd021e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b850e13c-eb92-466e-80ae-35821fa3a2df', 'volume_name': 'volume-b850e13c-eb92-466e-80ae-35821fa3a2df', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99050f03-53db-44f0-b31d-6ad43666dfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99050f03-53db-44f0-b31d-6ad43666dfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd9d71a-3e60-4c58-869b-67e6aaf3d474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:36 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Volume b850e13c-eb92-466e-80ae-35821fa3a2df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b850e13c-eb92-466e-80ae-35821fa3a2df', 'volume_size': 1} Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-194229138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b850e13c-eb92-466e-80ae-35821fa3a2df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504c6ee3adcb4bb7977b6ec0b3a607f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:36Z,use_quota=True,user_id='018982fab32248868798f75615c74de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Creating volume b850e13c-eb92-466e-80ae-35821fa3a2df {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:05:36 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b850e13c-eb92-466e-80ae-35821fa3a2df 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:36 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b850e13c-eb92-466e-80ae-35821fa3a2df 1073741824 Jul 21 19:05:36 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:36 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b850e13c-eb92-466e-80ae-35821fa3a2df 1073741824" returned: 0 in 0.575s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b850e13c-eb92-466e-80ae-35821fa3a2df {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:36 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b850e13c-eb92-466e-80ae-35821fa3a2df Jul 21 19:05:36 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:36 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b850e13c-eb92-466e-80ae-35821fa3a2df" returned: 0 in 0.316s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd9d71a-3e60-4c58-869b-67e6aaf3d474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b850e13c-eb92-466e-80ae-35821fa3a2df', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b07ca88e-d3ef-4531-94d8-0ec62ab0de7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:37 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Volume volume-b850e13c-eb92-466e-80ae-35821fa3a2df (b850e13c-eb92-466e-80ae-35821fa3a2df): created successfully Jul 21 19:05:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b07ca88e-d3ef-4531-94d8-0ec62ab0de7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Flow 'volume_create_manager' (e3a559ac-937f-4f4d-a4df-fb8ddb239b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:37 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-b49bf1d7-c829-48c9-9526-9f6878b09b6e tempest-AttachVolumeShelveTestJSON-1593560131 None] Created volume successfully. Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Flow 'volume_create_manager' (f1713b69-037a-4f11-9c6c-b5d89d9c5bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade7bab5-484d-43a6-a2b3-533d6f46157d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade7bab5-484d-43a6-a2b3-533d6f46157d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-169031959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282ea8c1-c0fe-4173-b663-8000b24ca7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f27224d6628439a8d2136fa4a7862f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:38Z,use_quota=True,user_id='32f41be5756848feacbfd1d0113c2b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1551fe67-9af2-4cab-87b7-d52f45337429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1551fe67-9af2-4cab-87b7-d52f45337429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cae37e-2058-4cde-be5b-47221b0768aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cae37e-2058-4cde-be5b-47221b0768aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '282ea8c1-c0fe-4173-b663-8000b24ca7c8', 'volume_name': 'volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8', 'volume_size': 2}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8989ae8-3450-4a81-a6f4-5ba82d6e22ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8989ae8-3450-4a81-a6f4-5ba82d6e22ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb5052b-b56a-4640-9e3c-1ef94d13f322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:38 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Volume 282ea8c1-c0fe-4173-b663-8000b24ca7c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8', 'volume_size': 2} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-169031959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282ea8c1-c0fe-4173-b663-8000b24ca7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f27224d6628439a8d2136fa4a7862f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:38Z,use_quota=True,user_id='32f41be5756848feacbfd1d0113c2b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Creating volume 282ea8c1-c0fe-4173-b663-8000b24ca7c8 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:05:38 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8 2147483648 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:38 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8 2147483648 Jul 21 19:05:38 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:38 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8 2147483648" returned: 0 in 0.617s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:38 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8 Jul 21 19:05:38 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:39 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8" returned: 0 in 0.278s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:05:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb5052b-b56a-4640-9e3c-1ef94d13f322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8', 'volume_size': 2}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ae2f34-4128-4e4a-99cd-f3e36105f5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:39 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Volume volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8 (282ea8c1-c0fe-4173-b663-8000b24ca7c8): created successfully Jul 21 19:05:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ae2f34-4128-4e4a-99cd-f3e36105f5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Flow 'volume_create_manager' (f1713b69-037a-4f11-9c6c-b5d89d9c5bfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:39 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-805c8605-291c-445b-b676-2f9be7e15e49 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Created volume successfully. Jul 21 19:05:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Creating offline snapshot d2b5ce16-dec6-49e8-998a-fe207b2162cc of volume 282ea8c1-c0fe-4173-b663-8000b24ca7c8 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:05:40 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f6599d-40fb-45f3-97ac-6eaf0aa8f240]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:40 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8 Jul 21 19:05:40 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:41 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8" returned: 0 in 0.686s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc 2G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:41 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc 2G Jul 21 19:05:41 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:42 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc 2G" returned: 0 in 0.713s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:42 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc Jul 21 19:05:42 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:42 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc" returned: 0 in 0.401s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:42 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc is being set with open permissions: ugo+rw Jul 21 19:05:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:42 devstack sudo[94855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc Jul 21 19:05:42 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:42 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc" returned: 0 in 0.288s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:42 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.info Jul 21 19:05:42 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:43 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.info" returned: 0 in 0.318s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:43 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.info is being set with open permissions: ugo+rw Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:43 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.info Jul 21 19:05:43 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:43 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.info" returned: 0 in 0.325s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.881s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:43 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4eac6062-1243-45d5-acca-c4c0f2864ec1 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Create snapshot completed successfully Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Flow 'volume_create_manager' (4e312cc9-49db-420f-ba34-fbbb4334c97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a977caf0-302f-4aab-9c12-0ca408cd51ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a977caf0-302f-4aab-9c12-0ca408cd51ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-204693481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f931807-a085-47c3-a802-3374f2b59a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0676da5a3c474112b1ca01855a642d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:44Z,use_quota=True,user_id='e7945a42613c46dca744dacdbebb4b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3376b0-1a25-4133-9184-4fb144905df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3376b0-1a25-4133-9184-4fb144905df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f137bc-5594-485d-b149-26d498ae2a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f137bc-5594-485d-b149-26d498ae2a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f931807-a085-47c3-a802-3374f2b59a5e', 'volume_name': 'volume-0f931807-a085-47c3-a802-3374f2b59a5e', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1e22b3-5fa7-4e9c-9687-ca5592208a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1e22b3-5fa7-4e9c-9687-ca5592208a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f396abf-aea7-4cfd-87c3-b564fbcf7c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:43 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Volume 0f931807-a085-47c3-a802-3374f2b59a5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f931807-a085-47c3-a802-3374f2b59a5e', 'volume_size': 1} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-204693481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f931807-a085-47c3-a802-3374f2b59a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0676da5a3c474112b1ca01855a642d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:44Z,use_quota=True,user_id='e7945a42613c46dca744dacdbebb4b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Creating volume 0f931807-a085-47c3-a802-3374f2b59a5e {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:05:43 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0f931807-a085-47c3-a802-3374f2b59a5e 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:43 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0f931807-a085-47c3-a802-3374f2b59a5e 1073741824 Jul 21 19:05:43 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:43 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Acquiring lock "cinder-d2b5ce16-dec6-49e8-998a-fe207b2162cc-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "cinder-d2b5ce16-dec6-49e8-998a-fe207b2162cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Acquiring lock "cinder-quobyte-282ea8c1-c0fe-4173-b663-8000b24ca7c8" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "cinder-quobyte-282ea8c1-c0fe-4173-b663-8000b24ca7c8" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Acquiring lock "cinder-quobyte-d2b5ce16-dec6-49e8-998a-fe207b2162cc" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "cinder-quobyte-d2b5ce16-dec6-49e8-998a-fe207b2162cc" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Deleting offline snapshot d2b5ce16-dec6-49e8-998a-fe207b2162cc of volume 282ea8c1-c0fe-4173-b663-8000b24ca7c8 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] snapshot_file for this snap is: volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[108fa8fa-0eea-4478-ba93-279a587cdd89]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:44 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc Jul 21 19:05:44 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:44 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0f931807-a085-47c3-a802-3374f2b59a5e 1073741824" returned: 0 in 0.873s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0f931807-a085-47c3-a802-3374f2b59a5e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:44 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0f931807-a085-47c3-a802-3374f2b59a5e Jul 21 19:05:44 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:44 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc" returned: 0 in 0.563s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85b815c-6a8d-4726-a399-575f5d60974f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:44 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:44 devstack sudo[94880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8 Jul 21 19:05:44 devstack sudo[94880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0f931807-a085-47c3-a802-3374f2b59a5e" returned: 0 in 0.325s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f396abf-aea7-4cfd-87c3-b564fbcf7c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f931807-a085-47c3-a802-3374f2b59a5e', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3827cccd-b2a2-4b3e-a2cd-f8a0ad3cee02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:45 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Volume volume-0f931807-a085-47c3-a802-3374f2b59a5e (0f931807-a085-47c3-a802-3374f2b59a5e): created successfully Jul 21 19:05:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3827cccd-b2a2-4b3e-a2cd-f8a0ad3cee02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Flow 'volume_create_manager' (4e312cc9-49db-420f-ba34-fbbb4334c97c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:45 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-11ebfd69-d7b4-469e-ba9f-c7c6481c4013 tempest-AttachVolumeNegativeTest-1325674848 None] Created volume successfully. Jul 21 19:05:45 devstack sudo[94880]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8" returned: 0 in 0.558s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:45 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc Jul 21 19:05:45 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:45 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc" returned: 0 in 0.635s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:46 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc Jul 21 19:05:46 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:46 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8.d2b5ce16-dec6-49e8-998a-fe207b2162cc" returned: 0 in 0.405s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:46 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "cinder-quobyte-d2b5ce16-dec6-49e8-998a-fe207b2162cc" released by "_delete_snapshot" :: held 2.356s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:46 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "cinder-quobyte-282ea8c1-c0fe-4173-b663-8000b24ca7c8" released by "delete_snapshot" :: held 2.415s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:46 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Created reservations ['4d9e6d68-72d8-4d70-a11e-03d34fec9456', '1a4b5e25-ed3d-49c7-b878-931e8a9cdb19', 'a226269d-1801-417f-8f82-3f0454cb0f21', 'bac26947-582f-430b-a766-1df0a9b17699'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:46 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Delete snapshot completed successfully. Jul 21 19:05:46 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5366171c-0edc-45bd-bff0-54ef4ee58e98 tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "cinder-d2b5ce16-dec6-49e8-998a-fe207b2162cc-delete_snapshot" released by "delete_snapshot" :: held 2.694s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-83475dea-731f-486b-a98d-e83538b1bb3e req-e69620a3-d211-4c45-ad46-3e7ad1aebf01 tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-83475dea-731f-486b-a98d-e83538b1bb3e req-e69620a3-d211-4c45-ad46-3e7ad1aebf01 tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-83475dea-731f-486b-a98d-e83538b1bb3e req-e69620a3-d211-4c45-ad46-3e7ad1aebf01 tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-83475dea-731f-486b-a98d-e83538b1bb3e req-e69620a3-d211-4c45-ad46-3e7ad1aebf01 tempest-AttachVolumeNegativeTest-1325674848 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-0f931807-a085-47c3-a802-3374f2b59a5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24ce5be9-3fab-4418-8745-d6695b93c9b2', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:05:47 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-83475dea-731f-486b-a98d-e83538b1bb3e req-e69620a3-d211-4c45-ad46-3e7ad1aebf01 tempest-AttachVolumeNegativeTest-1325674848 None] attachment_update completed successfully. Jul 21 19:05:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Acquiring lock "cinder-282ea8c1-c0fe-4173-b663-8000b24ca7c8-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "cinder-282ea8c1-c0fe-4173-b663-8000b24ca7c8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Acquiring lock "cinder-quobyte-282ea8c1-c0fe-4173-b663-8000b24ca7c8" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "cinder-quobyte-282ea8c1-c0fe-4173-b663-8000b24ca7c8" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:47 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49d1b06-333d-4807-8845-1b8e7e89b040]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:47 devstack sudo[95219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8 Jul 21 19:05:47 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:48 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8" returned: 0 in 0.616s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:48 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8 Jul 21 19:05:48 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:48 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-282ea8c1-c0fe-4173-b663-8000b24ca7c8" returned: 0 in 0.313s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "cinder-quobyte-282ea8c1-c0fe-4173-b663-8000b24ca7c8" released by "delete_volume" :: held 1.036s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:48 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Created reservations ['2a53a822-0f04-439e-bfa7-407de674fabc', '5e2387c5-7e16-4ef3-a49e-091090fba769', '72ad500b-be3a-4d4f-a792-30a3d5ce2b97', '72fc5888-0f54-419d-be9e-9cb02e8ba208'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:48 devstack sudo[95333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:05:48 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:49 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.358s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:49 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:49 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Deleted volume successfully. Jul 21 19:05:49 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7363a399-9d8d-4ddf-a9d3-81e41f36966a tempest-VolumesSnapshotNegativeTestJSON-692419263 None] Lock "cinder-282ea8c1-c0fe-4173-b663-8000b24ca7c8-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-eeb74b77-8d45-4414-b4d0-2d8b02ed8d35 req-f8cb7201-27f5-41c7-9479-c572c79df9e5 tempest-AttachVolumeShelveTestJSON-1593560131 None] No connector for attachment ab7ab1b5-0075-4ba4-82e4-79241d480e03; skipping storage backend terminate_connection call. {{(pid=87570) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 21 19:05:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-eeb74b77-8d45-4414-b4d0-2d8b02ed8d35 req-f8cb7201-27f5-41c7-9479-c572c79df9e5 tempest-AttachVolumeShelveTestJSON-1593560131 None] Deleting attachment ab7ab1b5-0075-4ba4-82e4-79241d480e03. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=101,cinder:INSERT=33,cinder:UPDATE=116,cinder:DELETE=10 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=126,cinder:SELECT=96,cinder:INSERT=27,cinder:DELETE=10 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:05:50 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-47c00ebf-7895-4672-bc4f-ed1237fd270b req-65528624-1c50-4ecc-9219-5f57303c73a3 tempest-AttachVolumeNegativeTest-1325674848 None] Terminate volume connection completed successfully. Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-47c00ebf-7895-4672-bc4f-ed1237fd270b req-65528624-1c50-4ecc-9219-5f57303c73a3 tempest-AttachVolumeNegativeTest-1325674848 None] Deleting attachment 24ce5be9-3fab-4418-8745-d6695b93c9b2. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Flow 'volume_create_manager' (400c3997-0355-4ea3-a346-6b9ee99f75b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc198ef-3377-410a-b196-0fc8b1bc5b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc198ef-3377-410a-b196-0fc8b1bc5b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1805378668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e6f8f5-f1a4-4073-8250-6ec30927bdf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='482b57857bec482c9afd803bf6acc624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:50Z,use_quota=True,user_id='7c2d1a73bc73440b8dbb4cfba3584fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49522a9b-294a-4297-b4b3-11cbdd456c5f),volume_type_id=49522a9b-294a-4297-b4b3-11cbdd456c5f)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ce7ab1-e74d-4ce4-9964-66083efed377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ce7ab1-e74d-4ce4-9964-66083efed377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f37628-489e-4e02-8186-8b6a7ec3fbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f37628-489e-4e02-8186-8b6a7ec3fbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36e6f8f5-f1a4-4073-8250-6ec30927bdf8', 'volume_name': 'volume-36e6f8f5-f1a4-4073-8250-6ec30927bdf8', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25a3e60-65d5-41af-89ec-506d0497c9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25a3e60-65d5-41af-89ec-506d0497c9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb275b9-214c-4e7b-8ae9-2741701e2ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:50 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Volume 36e6f8f5-f1a4-4073-8250-6ec30927bdf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36e6f8f5-f1a4-4073-8250-6ec30927bdf8', 'volume_size': 1} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1805378668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e6f8f5-f1a4-4073-8250-6ec30927bdf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='482b57857bec482c9afd803bf6acc624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:05:50Z,use_quota=True,user_id='7c2d1a73bc73440b8dbb4cfba3584fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49522a9b-294a-4297-b4b3-11cbdd456c5f),volume_type_id=49522a9b-294a-4297-b4b3-11cbdd456c5f)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Creating volume 36e6f8f5-f1a4-4073-8250-6ec30927bdf8 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:05:50 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:05:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-36e6f8f5-f1a4-4073-8250-6ec30927bdf8 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:50 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-36e6f8f5-f1a4-4073-8250-6ec30927bdf8 1073741824 Jul 21 19:05:50 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:51 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-36e6f8f5-f1a4-4073-8250-6ec30927bdf8 1073741824" returned: 0 in 0.703s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-36e6f8f5-f1a4-4073-8250-6ec30927bdf8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:51 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-36e6f8f5-f1a4-4073-8250-6ec30927bdf8 Jul 21 19:05:51 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:51 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-36e6f8f5-f1a4-4073-8250-6ec30927bdf8" returned: 0 in 0.486s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:05:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb275b9-214c-4e7b-8ae9-2741701e2ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36e6f8f5-f1a4-4073-8250-6ec30927bdf8', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d4dd67-b4e5-4913-b07b-99979374a2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:05:51 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Volume volume-36e6f8f5-f1a4-4073-8250-6ec30927bdf8 (36e6f8f5-f1a4-4073-8250-6ec30927bdf8): created successfully Jul 21 19:05:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d4dd67-b4e5-4913-b07b-99979374a2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:05:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Flow 'volume_create_manager' (400c3997-0355-4ea3-a346-6b9ee99f75b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:05:52 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-ac398da4-ca4a-4f88-8e1d-e754203bceb2 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Created volume successfully. Jul 21 19:05:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-026202f3-aa01-4afd-851c-8ce25bdc50a1 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-026202f3-aa01-4afd-851c-8ce25bdc50a1 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-026202f3-aa01-4afd-851c-8ce25bdc50a1 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-026202f3-aa01-4afd-851c-8ce25bdc50a1 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-026202f3-aa01-4afd-851c-8ce25bdc50a1 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-026202f3-aa01-4afd-851c-8ce25bdc50a1 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:53 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:05:53 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:53 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-026202f3-aa01-4afd-851c-8ce25bdc50a1 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.350s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:53 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-026202f3-aa01-4afd-851c-8ce25bdc50a1 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:53 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-026202f3-aa01-4afd-851c-8ce25bdc50a1 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Retype volume completed successfully. Jul 21 19:05:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Acquiring lock "cinder-36e6f8f5-f1a4-4073-8250-6ec30927bdf8-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Lock "cinder-36e6f8f5-f1a4-4073-8250-6ec30927bdf8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Acquiring lock "cinder-quobyte-36e6f8f5-f1a4-4073-8250-6ec30927bdf8" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:05:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Lock "cinder-quobyte-36e6f8f5-f1a4-4073-8250-6ec30927bdf8" acquired by "delete_volume" :: waited 0.033s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:05:55 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15d1c3d-3656-463f-a8c4-de50e2f5ce4b]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:05:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-36e6f8f5-f1a4-4073-8250-6ec30927bdf8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:55 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-36e6f8f5-f1a4-4073-8250-6ec30927bdf8 Jul 21 19:05:55 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:55 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-36e6f8f5-f1a4-4073-8250-6ec30927bdf8" returned: 0 in 0.453s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-36e6f8f5-f1a4-4073-8250-6ec30927bdf8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:55 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-36e6f8f5-f1a4-4073-8250-6ec30927bdf8 Jul 21 19:05:55 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:55 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-36e6f8f5-f1a4-4073-8250-6ec30927bdf8" returned: 0 in 0.351s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Lock "cinder-quobyte-36e6f8f5-f1a4-4073-8250-6ec30927bdf8" released by "delete_volume" :: held 0.861s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:55 devstack cinder-volume[87570]: WARNING cinder.quota [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:05:55 devstack cinder-volume[87570]: WARNING cinder.quota [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:05:55 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Created reservations ['563d5316-a53f-4a36-91ad-283f7849a6de', '27d2853d-df7f-4bfb-bfce-ae6a9092a46d', 'fc4d5376-4a8f-47cd-b549-11e1e6c4379d', '96ae825d-3409-4334-943f-d2da7c4d8893'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:05:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:56 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:05:56 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:56 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.315s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:56 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:56 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Deleted volume successfully. Jul 21 19:05:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4c861b77-e93f-49a0-9fc0-e97a335155b6 tempest-VolumeRetypeWithoutMigrationTest-1498526374 None] Lock "cinder-36e6f8f5-f1a4-4073-8250-6ec30927bdf8-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:05:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:05:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:56 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:05:56 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:57 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.317s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:05:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:05:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:06:06 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=16,cinder:SELECT=18,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:06:06 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=10,cinder:INSERT=3,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Flow 'volume_create_manager' (822d1cd4-20ee-4082-87bf-88bcb82dcf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573798c6-be48-4159-b595-733aae58805a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573798c6-be48-4159-b595-733aae58805a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1369233721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28772db7-09df-44e6-8757-e9acf020d6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d488a40b1b418a8b7ad04f8622f0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:08Z,use_quota=True,user_id='7f4af8627c9a43e0af73d4c950a998f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58fae5b-9952-40d6-916b-f4eb10d18f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58fae5b-9952-40d6-916b-f4eb10d18f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9900c14c-a374-4452-97bf-24fddd40445a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9900c14c-a374-4452-97bf-24fddd40445a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28772db7-09df-44e6-8757-e9acf020d6f4', 'volume_name': 'volume-28772db7-09df-44e6-8757-e9acf020d6f4', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff551f2-b157-4009-aa94-38489a2476ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff551f2-b157-4009-aa94-38489a2476ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd50794-b500-41be-b29f-14a991b1e937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:08 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Volume 28772db7-09df-44e6-8757-e9acf020d6f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28772db7-09df-44e6-8757-e9acf020d6f4', 'volume_size': 1} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1369233721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28772db7-09df-44e6-8757-e9acf020d6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d488a40b1b418a8b7ad04f8622f0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:08Z,use_quota=True,user_id='7f4af8627c9a43e0af73d4c950a998f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Creating volume 28772db7-09df-44e6-8757-e9acf020d6f4 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:08 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:08 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4 1073741824 Jul 21 19:06:08 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:08 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4 1073741824" returned: 0 in 0.688s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:08 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4 Jul 21 19:06:08 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:09 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4" returned: 0 in 0.367s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd50794-b500-41be-b29f-14a991b1e937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28772db7-09df-44e6-8757-e9acf020d6f4', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742a6428-ed36-432c-8e55-4976a730e501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:09 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Volume volume-28772db7-09df-44e6-8757-e9acf020d6f4 (28772db7-09df-44e6-8757-e9acf020d6f4): created successfully Jul 21 19:06:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742a6428-ed36-432c-8e55-4976a730e501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Flow 'volume_create_manager' (822d1cd4-20ee-4082-87bf-88bcb82dcf04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:09 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-7df7a086-7f61-4687-92a5-d48679675efd tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Created volume successfully. Jul 21 19:06:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Creating offline snapshot 6649b51c-fc9e-4338-9a36-3b44691d1fac of volume 28772db7-09df-44e6-8757-e9acf020d6f4 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:06:10 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e02e2fc-4c23-45ba-913b-9e33e7b5c9c3]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:10 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4 Jul 21 19:06:10 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:11 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4" returned: 0 in 0.701s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:11 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac 1G Jul 21 19:06:11 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:12 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac 1G" returned: 0 in 1.323s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28772db7-09df-44e6-8757-e9acf020d6f4 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:12 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28772db7-09df-44e6-8757-e9acf020d6f4 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac Jul 21 19:06:12 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:13 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28772db7-09df-44e6-8757-e9acf020d6f4 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac" returned: 0 in 0.580s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:13 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac is being set with open permissions: ugo+rw Jul 21 19:06:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:13 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac Jul 21 19:06:13 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:13 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac" returned: 0 in 0.510s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:13 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.info Jul 21 19:06:13 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:14 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.info" returned: 0 in 0.515s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:14 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.info is being set with open permissions: ugo+rw Jul 21 19:06:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:14 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.info Jul 21 19:06:14 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:14 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.info" returned: 0 in 0.691s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.585s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:15 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-d14c1619-32db-40da-9c6f-afd72ea9ce50 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Create snapshot completed successfully Jul 21 19:06:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Acquiring lock "cinder-6649b51c-fc9e-4338-9a36-3b44691d1fac-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "cinder-6649b51c-fc9e-4338-9a36-3b44691d1fac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Acquiring lock "cinder-quobyte-28772db7-09df-44e6-8757-e9acf020d6f4" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "cinder-quobyte-28772db7-09df-44e6-8757-e9acf020d6f4" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Acquiring lock "cinder-quobyte-6649b51c-fc9e-4338-9a36-3b44691d1fac" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "cinder-quobyte-6649b51c-fc9e-4338-9a36-3b44691d1fac" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Deleting offline snapshot 6649b51c-fc9e-4338-9a36-3b44691d1fac of volume 28772db7-09df-44e6-8757-e9acf020d6f4 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:06:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] snapshot_file for this snap is: volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:06:17 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7d1681-d0a2-4a2d-97a1-9f2c3ec78a95]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:17 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac Jul 21 19:06:17 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:17 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac" returned: 0 in 0.632s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28772db7-09df-44e6-8757-e9acf020d6f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:06:17 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c0cc4d-84e1-411c-8d80-51d6860ecef0]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:18 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4 Jul 21 19:06:18 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:18 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4" returned: 0 in 0.523s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:18 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac Jul 21 19:06:18 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:18 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac" returned: 0 in 0.427s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:18 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac Jul 21 19:06:18 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:19 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4.6649b51c-fc9e-4338-9a36-3b44691d1fac" returned: 0 in 0.281s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "cinder-quobyte-6649b51c-fc9e-4338-9a36-3b44691d1fac" released by "_delete_snapshot" :: held 2.087s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "cinder-quobyte-28772db7-09df-44e6-8757-e9acf020d6f4" released by "delete_snapshot" :: held 2.145s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:19 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Created reservations ['87a00c24-16b5-40b3-bd10-7d56a42a76bd', '7fe3a7ef-7e6f-437a-875e-0f90fdd07744', 'e7639a00-426a-4607-a237-561a13961ac8', 'caa6dd16-117a-4bef-8103-74dc480fe91e'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:19 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Delete snapshot completed successfully. Jul 21 19:06:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c9225e05-373a-4d5c-94f8-810b2174a693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "cinder-6649b51c-fc9e-4338-9a36-3b44691d1fac-delete_snapshot" released by "delete_snapshot" :: held 2.366s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Acquiring lock "cinder-28772db7-09df-44e6-8757-e9acf020d6f4-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "cinder-28772db7-09df-44e6-8757-e9acf020d6f4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Acquiring lock "cinder-quobyte-28772db7-09df-44e6-8757-e9acf020d6f4" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "cinder-quobyte-28772db7-09df-44e6-8757-e9acf020d6f4" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:20 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[e174523a-34bf-4016-a1e0-0d67f169ec4b]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:20 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4 Jul 21 19:06:20 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:21 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4" returned: 0 in 0.663s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:21 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4 Jul 21 19:06:21 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:21 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-28772db7-09df-44e6-8757-e9acf020d6f4" returned: 0 in 0.367s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "cinder-quobyte-28772db7-09df-44e6-8757-e9acf020d6f4" released by "delete_volume" :: held 1.106s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:21 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Created reservations ['3f5e6732-261c-4e43-bb63-e75a444bf5da', '727ce5f2-c086-4e7c-8e97-4e8cf91e0884', '4ee224c3-0d54-42d6-baf4-97eb6c7368f7', '476b7dd4-5a70-41aa-a56b-f37bbee282c1'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:21 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:06:21 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:21 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.257s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:21 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:21 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Deleted volume successfully. Jul 21 19:06:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fdbb3085-49c5-45c1-aa46-6c6d1e27931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1272640407 None] Lock "cinder-28772db7-09df-44e6-8757-e9acf020d6f4-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Flow 'volume_create_manager' (97108e24-d8d2-45bc-afbe-a6823ff9aa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8456b163-93b0-4fdb-9142-a7cb66a2c936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8456b163-93b0-4fdb-9142-a7cb66a2c936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1415141350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9638e25a-2b97-4947-9dac-b38be90bd2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8392b788734140f9acd020232dd7c84d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:31Z,use_quota=True,user_id='193347ab1043467bbc02234011ad49cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a97cc0df-a091-4f2e-862a-bb0614bb3d8d),volume_type_id=a97cc0df-a091-4f2e-862a-bb0614bb3d8d)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eefc6d5-936e-4ddc-9644-7108972ce51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eefc6d5-936e-4ddc-9644-7108972ce51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8468e8ed-5010-4382-89e1-cd8adc8c82c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8468e8ed-5010-4382-89e1-cd8adc8c82c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9638e25a-2b97-4947-9dac-b38be90bd2c3', 'volume_name': 'volume-9638e25a-2b97-4947-9dac-b38be90bd2c3', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4262d331-df20-4349-8749-7ec9980bd533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4262d331-df20-4349-8749-7ec9980bd533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aaa750a-e5aa-41b3-af87-94f2db9ca2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:31 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Volume 9638e25a-2b97-4947-9dac-b38be90bd2c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9638e25a-2b97-4947-9dac-b38be90bd2c3', 'volume_size': 1} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1415141350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9638e25a-2b97-4947-9dac-b38be90bd2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8392b788734140f9acd020232dd7c84d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:31Z,use_quota=True,user_id='193347ab1043467bbc02234011ad49cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a97cc0df-a091-4f2e-862a-bb0614bb3d8d),volume_type_id=a97cc0df-a091-4f2e-862a-bb0614bb3d8d)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Creating volume 9638e25a-2b97-4947-9dac-b38be90bd2c3 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:31 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9638e25a-2b97-4947-9dac-b38be90bd2c3 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:31 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9638e25a-2b97-4947-9dac-b38be90bd2c3 1073741824 Jul 21 19:06:31 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:31 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9638e25a-2b97-4947-9dac-b38be90bd2c3 1073741824" returned: 0 in 0.590s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9638e25a-2b97-4947-9dac-b38be90bd2c3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:31 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9638e25a-2b97-4947-9dac-b38be90bd2c3 Jul 21 19:06:31 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:32 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9638e25a-2b97-4947-9dac-b38be90bd2c3" returned: 0 in 0.341s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:32 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aaa750a-e5aa-41b3-af87-94f2db9ca2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9638e25a-2b97-4947-9dac-b38be90bd2c3', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621a4ea8-a1de-408e-8ca7-8d8e8e30b423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:32 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Volume volume-9638e25a-2b97-4947-9dac-b38be90bd2c3 (9638e25a-2b97-4947-9dac-b38be90bd2c3): created successfully Jul 21 19:06:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621a4ea8-a1de-408e-8ca7-8d8e8e30b423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Flow 'volume_create_manager' (97108e24-d8d2-45bc-afbe-a6823ff9aa14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:32 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-dd9311ca-3817-41f8-813b-990ddbb0590d tempest-VolumeTypesAccessTest-1081615145 None] Created volume successfully. Jul 21 19:06:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Acquiring lock "cinder-9638e25a-2b97-4947-9dac-b38be90bd2c3-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Lock "cinder-9638e25a-2b97-4947-9dac-b38be90bd2c3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Acquiring lock "cinder-quobyte-9638e25a-2b97-4947-9dac-b38be90bd2c3" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Lock "cinder-quobyte-9638e25a-2b97-4947-9dac-b38be90bd2c3" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:33 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec9d1c6-cacd-479f-864c-a58be9e369ee]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9638e25a-2b97-4947-9dac-b38be90bd2c3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:33 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9638e25a-2b97-4947-9dac-b38be90bd2c3 Jul 21 19:06:33 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:33 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9638e25a-2b97-4947-9dac-b38be90bd2c3" returned: 0 in 0.447s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9638e25a-2b97-4947-9dac-b38be90bd2c3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:33 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9638e25a-2b97-4947-9dac-b38be90bd2c3 Jul 21 19:06:33 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:34 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9638e25a-2b97-4947-9dac-b38be90bd2c3" returned: 0 in 0.344s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Lock "cinder-quobyte-9638e25a-2b97-4947-9dac-b38be90bd2c3" released by "delete_volume" :: held 0.839s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:34 devstack cinder-volume[87570]: WARNING cinder.quota [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1381526729 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1381526729, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:06:34 devstack cinder-volume[87570]: WARNING cinder.quota [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1381526729 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1381526729, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:06:34 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Created reservations ['5b31ae0d-ff44-4276-bef7-c8eb5e10d5ed', '60775e30-f802-46bb-9f68-b6e0da8f843f', 'c2ba0ca1-5373-4fba-9b82-fe05cd1e19bd', '001e2dc3-1d32-460f-a168-70808579286a'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:34 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:06:34 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:34 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.547s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:34 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:34 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Deleted volume successfully. Jul 21 19:06:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-74908ac3-1607-4b17-aa6c-0b86e4ba6685 tempest-VolumeTypesAccessTest-1081615145 None] Lock "cinder-9638e25a-2b97-4947-9dac-b38be90bd2c3-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] Acquiring lock "cinder-b850e13c-eb92-466e-80ae-35821fa3a2df-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] Lock "cinder-b850e13c-eb92-466e-80ae-35821fa3a2df-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] Acquiring lock "cinder-quobyte-b850e13c-eb92-466e-80ae-35821fa3a2df" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] Lock "cinder-quobyte-b850e13c-eb92-466e-80ae-35821fa3a2df" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:35 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bd4ae5-8fd4-4f05-8340-bb0ec991d1c5]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b850e13c-eb92-466e-80ae-35821fa3a2df {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:36 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b850e13c-eb92-466e-80ae-35821fa3a2df Jul 21 19:06:36 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:36 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b850e13c-eb92-466e-80ae-35821fa3a2df" returned: 0 in 0.840s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b850e13c-eb92-466e-80ae-35821fa3a2df {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:36 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b850e13c-eb92-466e-80ae-35821fa3a2df Jul 21 19:06:36 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:36 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b850e13c-eb92-466e-80ae-35821fa3a2df" returned: 0 in 0.382s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] Lock "cinder-quobyte-b850e13c-eb92-466e-80ae-35821fa3a2df" released by "delete_volume" :: held 1.295s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] Created reservations ['f3175593-99f7-4948-9add-5f53853212b5', '19fdb366-3713-4c4e-8868-aad115f8fcfa', '6d962511-c5f0-4980-8ead-90661807f50c', '5b308fe3-7bbc-4664-ad7b-b3cf1e009d0b'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:37 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:06:37 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:37 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.469s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:37 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] Deleted volume successfully. Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ff2e4ca0-2e4f-45cc-bb23-929c26a1b90a tempest-AttachVolumeShelveTestJSON-1593560131 None] Lock "cinder-b850e13c-eb92-466e-80ae-35821fa3a2df-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Flow 'volume_create_manager' (1ccf0ea6-c80b-4ef7-a1ab-7cc0d4a78143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89cce1ce-e07c-4165-af10-98c10a0bd4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89cce1ce-e07c-4165-af10-98c10a0bd4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1377844056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c2273c-4dfa-474d-88bb-77528f706469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0676da5a3c474112b1ca01855a642d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:38Z,use_quota=True,user_id='e7945a42613c46dca744dacdbebb4b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d926b2-ccc7-4b0c-bef2-45b39ecddcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d926b2-ccc7-4b0c-bef2-45b39ecddcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74791df6-58a3-48b7-b6ef-ed0a6ff0f10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74791df6-58a3-48b7-b6ef-ed0a6ff0f10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5c2273c-4dfa-474d-88bb-77528f706469', 'volume_name': 'volume-f5c2273c-4dfa-474d-88bb-77528f706469', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf618e35-c0fe-44a0-86eb-e0bdf6622a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf618e35-c0fe-44a0-86eb-e0bdf6622a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078315fc-34fa-404a-99ba-250b705615f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:37 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Volume f5c2273c-4dfa-474d-88bb-77528f706469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5c2273c-4dfa-474d-88bb-77528f706469', 'volume_size': 1} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1377844056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c2273c-4dfa-474d-88bb-77528f706469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0676da5a3c474112b1ca01855a642d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:38Z,use_quota=True,user_id='e7945a42613c46dca744dacdbebb4b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Creating volume f5c2273c-4dfa-474d-88bb-77528f706469 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:37 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:06:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f5c2273c-4dfa-474d-88bb-77528f706469 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:38 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f5c2273c-4dfa-474d-88bb-77528f706469 1073741824 Jul 21 19:06:38 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:38 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f5c2273c-4dfa-474d-88bb-77528f706469 1073741824" returned: 0 in 0.677s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f5c2273c-4dfa-474d-88bb-77528f706469 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:38 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f5c2273c-4dfa-474d-88bb-77528f706469 Jul 21 19:06:38 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:39 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f5c2273c-4dfa-474d-88bb-77528f706469" returned: 0 in 0.372s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078315fc-34fa-404a-99ba-250b705615f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5c2273c-4dfa-474d-88bb-77528f706469', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87241e5-8d5a-49b6-9446-398e6552d001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:39 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Volume volume-f5c2273c-4dfa-474d-88bb-77528f706469 (f5c2273c-4dfa-474d-88bb-77528f706469): created successfully Jul 21 19:06:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87241e5-8d5a-49b6-9446-398e6552d001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Flow 'volume_create_manager' (1ccf0ea6-c80b-4ef7-a1ab-7cc0d4a78143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:39 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-76f292e0-fbd5-4806-a85c-53492bb8c26a tempest-AttachVolumeNegativeTest-1325674848 None] Created volume successfully. Jul 21 19:06:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-1db9c172-8e87-4eb1-bd53-3980f1a26613 req-a219c9df-bf84-4cac-9d19-efeb866643fb tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-1db9c172-8e87-4eb1-bd53-3980f1a26613 req-a219c9df-bf84-4cac-9d19-efeb866643fb tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-1db9c172-8e87-4eb1-bd53-3980f1a26613 req-a219c9df-bf84-4cac-9d19-efeb866643fb tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-1db9c172-8e87-4eb1-bd53-3980f1a26613 req-a219c9df-bf84-4cac-9d19-efeb866643fb tempest-AttachVolumeNegativeTest-1325674848 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-f5c2273c-4dfa-474d-88bb-77528f706469', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '19c79d1c-145c-4bbf-9290-04dc8bd3f202', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:06:40 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-1db9c172-8e87-4eb1-bd53-3980f1a26613 req-a219c9df-bf84-4cac-9d19-efeb866643fb tempest-AttachVolumeNegativeTest-1325674848 None] attachment_update completed successfully. Jul 21 19:06:44 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-717b18c9-384d-4b13-8581-fdd77ecde187 req-60e4408f-04de-4a63-b851-e2dead26941a tempest-AttachVolumeNegativeTest-1325674848 None] Terminate volume connection completed successfully. Jul 21 19:06:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-717b18c9-384d-4b13-8581-fdd77ecde187 req-60e4408f-04de-4a63-b851-e2dead26941a tempest-AttachVolumeNegativeTest-1325674848 None] Deleting attachment 19c79d1c-145c-4bbf-9290-04dc8bd3f202. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Flow 'volume_create_manager' (0f5e9deb-a922-4c2d-ac86-2fdb7263750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (435e9b41-f3ea-468f-b347-58d90ab92c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (435e9b41-f3ea-468f-b347-58d90ab92c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-247534108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9b1a84-efa7-402d-b36a-147713037f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b8c242eaf2c4450b42aa4a713bf13bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:49Z,use_quota=True,user_id='47b66145a75e4947b8a47c18618592ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b1b8e6-052e-4224-89b7-95f0ba2672fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b1b8e6-052e-4224-89b7-95f0ba2672fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c25d483-680a-449e-b155-fb2078c0c2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c25d483-680a-449e-b155-fb2078c0c2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b9b1a84-efa7-402d-b36a-147713037f26', 'volume_name': 'volume-3b9b1a84-efa7-402d-b36a-147713037f26', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e941137-8766-473c-aeac-4d22bbdcd2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e941137-8766-473c-aeac-4d22bbdcd2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed05670-5238-4ef4-9648-2b6be3ada42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:49 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Volume 3b9b1a84-efa7-402d-b36a-147713037f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b9b1a84-efa7-402d-b36a-147713037f26', 'volume_size': 1} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-247534108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9b1a84-efa7-402d-b36a-147713037f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b8c242eaf2c4450b42aa4a713bf13bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:49Z,use_quota=True,user_id='47b66145a75e4947b8a47c18618592ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Creating volume 3b9b1a84-efa7-402d-b36a-147713037f26 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:49 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:06:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3b9b1a84-efa7-402d-b36a-147713037f26 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:49 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3b9b1a84-efa7-402d-b36a-147713037f26 1073741824 Jul 21 19:06:49 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:50 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3b9b1a84-efa7-402d-b36a-147713037f26 1073741824" returned: 0 in 0.805s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3b9b1a84-efa7-402d-b36a-147713037f26 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:50 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3b9b1a84-efa7-402d-b36a-147713037f26 Jul 21 19:06:50 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:50 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3b9b1a84-efa7-402d-b36a-147713037f26" returned: 0 in 0.407s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed05670-5238-4ef4-9648-2b6be3ada42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b9b1a84-efa7-402d-b36a-147713037f26', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191cf99b-6a5e-4553-9fc0-db0989efa2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:50 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Volume volume-3b9b1a84-efa7-402d-b36a-147713037f26 (3b9b1a84-efa7-402d-b36a-147713037f26): created successfully Jul 21 19:06:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191cf99b-6a5e-4553-9fc0-db0989efa2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Flow 'volume_create_manager' (0f5e9deb-a922-4c2d-ac86-2fdb7263750a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:50 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0d9e3dba-7b2f-4e3c-a980-640fa0bc015a tempest-TestMinimumBasicScenario-505434839 None] Created volume successfully. Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "cinder-f5c2273c-4dfa-474d-88bb-77528f706469-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] Lock "cinder-f5c2273c-4dfa-474d-88bb-77528f706469-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "cinder-quobyte-f5c2273c-4dfa-474d-88bb-77528f706469" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] Lock "cinder-quobyte-f5c2273c-4dfa-474d-88bb-77528f706469" acquired by "delete_volume" :: waited 0.046s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c1e38e-43cd-459a-9ea1-409afcd3b9d2]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f5c2273c-4dfa-474d-88bb-77528f706469 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Flow 'volume_create_manager' (6503726d-212d-41ff-9c2f-ed1b3a67366a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2361caa3-7f43-411a-9d38-974de2857847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:52 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f5c2273c-4dfa-474d-88bb-77528f706469 Jul 21 19:06:52 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2361caa3-7f43-411a-9d38-974de2857847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-279102079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13424f92-23f4-44ec-8003-f7ccb20affd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780514ea769445a483f9d8a5606b7f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:52Z,use_quota=True,user_id='3c08d0c3b2b3496face67f0f9096e836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad131215-df42-4900-bda9-a66a9d48a36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad131215-df42-4900-bda9-a66a9d48a36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c35306-64fe-492a-bdd2-47ace42ab823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c35306-64fe-492a-bdd2-47ace42ab823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13424f92-23f4-44ec-8003-f7ccb20affd9', 'volume_name': 'volume-13424f92-23f4-44ec-8003-f7ccb20affd9', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52145bb-0587-4c95-9018-f8dfb9a4363f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52145bb-0587-4c95-9018-f8dfb9a4363f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3760d008-0c82-4f7f-9843-4509494dc317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:52 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Volume 13424f92-23f4-44ec-8003-f7ccb20affd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13424f92-23f4-44ec-8003-f7ccb20affd9', 'volume_size': 1} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-279102079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13424f92-23f4-44ec-8003-f7ccb20affd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780514ea769445a483f9d8a5606b7f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:52Z,use_quota=True,user_id='3c08d0c3b2b3496face67f0f9096e836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Creating volume 13424f92-23f4-44ec-8003-f7ccb20affd9 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:52 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-13424f92-23f4-44ec-8003-f7ccb20affd9 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:52 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-13424f92-23f4-44ec-8003-f7ccb20affd9 1073741824 Jul 21 19:06:52 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-53c8f04f-1a05-43fa-9c55-cab17f54edd6 req-fdac5822-7f7c-4261-b848-bb2c28a1554d tempest-TestMinimumBasicScenario-505434839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:52 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f5c2273c-4dfa-474d-88bb-77528f706469" returned: 0 in 0.656s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f5c2273c-4dfa-474d-88bb-77528f706469 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:52 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f5c2273c-4dfa-474d-88bb-77528f706469 Jul 21 19:06:52 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:53 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-13424f92-23f4-44ec-8003-f7ccb20affd9 1073741824" returned: 0 in 0.589s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-13424f92-23f4-44ec-8003-f7ccb20affd9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:53 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f5c2273c-4dfa-474d-88bb-77528f706469" returned: 0 in 0.348s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:53 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-13424f92-23f4-44ec-8003-f7ccb20affd9 Jul 21 19:06:53 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] Lock "cinder-quobyte-f5c2273c-4dfa-474d-88bb-77528f706469" released by "delete_volume" :: held 1.070s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] Created reservations ['c0d3a3f5-a781-4936-bcc6-40fc18abb874', '010ccc69-6284-4ffb-a1b2-abff2fbfba61', 'b3db1256-1467-4283-89ef-b0f3dd5aafe1', 'c4bd409b-f386-49fd-b0fd-3604b53add74'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:53 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:06:53 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:53 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-13424f92-23f4-44ec-8003-f7ccb20affd9" returned: 0 in 0.370s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-53c8f04f-1a05-43fa-9c55-cab17f54edd6 req-fdac5822-7f7c-4261-b848-bb2c28a1554d tempest-TestMinimumBasicScenario-505434839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.986s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-53c8f04f-1a05-43fa-9c55-cab17f54edd6 req-fdac5822-7f7c-4261-b848-bb2c28a1554d tempest-TestMinimumBasicScenario-505434839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3760d008-0c82-4f7f-9843-4509494dc317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13424f92-23f4-44ec-8003-f7ccb20affd9', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfe2ba3-6e43-42fa-996c-a5dc38e3eb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:53 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Volume volume-13424f92-23f4-44ec-8003-f7ccb20affd9 (13424f92-23f4-44ec-8003-f7ccb20affd9): created successfully Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfe2ba3-6e43-42fa-996c-a5dc38e3eb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Flow 'volume_create_manager' (6503726d-212d-41ff-9c2f-ed1b3a67366a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:53 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f16995a1-bf11-4786-9bf6-9466449403f4 tempest-VolumesMetadataTest-1247669069 None] Created volume successfully. Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-53c8f04f-1a05-43fa-9c55-cab17f54edd6 req-fdac5822-7f7c-4261-b848-bb2c28a1554d tempest-TestMinimumBasicScenario-505434839 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-3b9b1a84-efa7-402d-b36a-147713037f26', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5d605f3-921a-4087-9420-89c1fb9477ac', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "cinder-0f931807-a085-47c3-a802-3374f2b59a5e-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:53 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:53 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Flow 'volume_create_manager' (2001401f-44c2-40f3-bfa6-6c9a44d184bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76925573-7722-4862-9a84-8a34e12516dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] Lock "cinder-0f931807-a085-47c3-a802-3374f2b59a5e-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.524s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:54 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] Deleted volume successfully. Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76925573-7722-4862-9a84-8a34e12516dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-975236995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=552945d2-3f51-442c-86c7-42e13b9aa319,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ba6f1691b99420eb3fb52ced633e31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:54Z,use_quota=True,user_id='4b9ad6fc6cb548ffaf89cf014d67378e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802a7185-1d6c-40eb-8045-46d00233fa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802a7185-1d6c-40eb-8045-46d00233fa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af1c8b3-9ea6-425c-9549-793abf017ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af1c8b3-9ea6-425c-9549-793abf017ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '552945d2-3f51-442c-86c7-42e13b9aa319', 'volume_name': 'volume-552945d2-3f51-442c-86c7-42e13b9aa319', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab008af2-90fb-4e61-8d40-0f8adb2e680e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab008af2-90fb-4e61-8d40-0f8adb2e680e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d74b966-dcdd-43a3-9097-b074372279e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:54 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Volume 552945d2-3f51-442c-86c7-42e13b9aa319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-552945d2-3f51-442c-86c7-42e13b9aa319', 'volume_size': 1} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-975236995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=552945d2-3f51-442c-86c7-42e13b9aa319,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ba6f1691b99420eb3fb52ced633e31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:54Z,use_quota=True,user_id='4b9ad6fc6cb548ffaf89cf014d67378e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Creating volume 552945d2-3f51-442c-86c7-42e13b9aa319 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:54 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-552945d2-3f51-442c-86c7-42e13b9aa319 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:54 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-552945d2-3f51-442c-86c7-42e13b9aa319 1073741824 Jul 21 19:06:54 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "cinder-quobyte-0f931807-a085-47c3-a802-3374f2b59a5e" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:54 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-53c8f04f-1a05-43fa-9c55-cab17f54edd6 req-fdac5822-7f7c-4261-b848-bb2c28a1554d tempest-TestMinimumBasicScenario-505434839 None] attachment_update completed successfully. Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] Lock "cinder-quobyte-0f931807-a085-47c3-a802-3374f2b59a5e" acquired by "delete_volume" :: waited 0.034s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-137d359a-85bd-4a6b-9a2f-cccd89e4459d tempest-AttachVolumeNegativeTest-1325674848 None] Lock "cinder-f5c2273c-4dfa-474d-88bb-77528f706469-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a56279-06df-4c85-a49f-71c5331d316e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0f931807-a085-47c3-a802-3374f2b59a5e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:54 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0f931807-a085-47c3-a802-3374f2b59a5e Jul 21 19:06:54 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:54 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0f931807-a085-47c3-a802-3374f2b59a5e" returned: 0 in 0.497s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0f931807-a085-47c3-a802-3374f2b59a5e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:54 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-552945d2-3f51-442c-86c7-42e13b9aa319 1073741824" returned: 0 in 0.651s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:54 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0f931807-a085-47c3-a802-3374f2b59a5e Jul 21 19:06:54 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-552945d2-3f51-442c-86c7-42e13b9aa319 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:54 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-552945d2-3f51-442c-86c7-42e13b9aa319 Jul 21 19:06:54 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:55 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0f931807-a085-47c3-a802-3374f2b59a5e" returned: 0 in 0.344s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] Lock "cinder-quobyte-0f931807-a085-47c3-a802-3374f2b59a5e" released by "delete_volume" :: held 0.902s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] Created reservations ['4392354e-ad55-4978-81ce-342178b58ad5', '10831083-b9ad-45b4-b4ee-ecc269d5a987', 'c28991f1-bf7f-45ef-99cf-38540cdc01eb', '611563ae-42ad-471c-9f4e-5b1f17d3bf5e'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:55 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:06:55 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:55 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-552945d2-3f51-442c-86c7-42e13b9aa319" returned: 0 in 0.607s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d74b966-dcdd-43a3-9097-b074372279e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-552945d2-3f51-442c-86c7-42e13b9aa319', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ceb459-158b-48f5-86a3-c141a118b703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:55 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Volume volume-552945d2-3f51-442c-86c7-42e13b9aa319 (552945d2-3f51-442c-86c7-42e13b9aa319): created successfully Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ceb459-158b-48f5-86a3-c141a118b703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Flow 'volume_create_manager' (2001401f-44c2-40f3-bfa6-6c9a44d184bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:55 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-7f0298d4-5770-426a-8e5c-ce64d58e1a7b tempest-VolumesTestJSON-301519497 None] Created volume successfully. Jul 21 19:06:55 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.354s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:55 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] Deleted volume successfully. Jul 21 19:06:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-98f93a05-9d03-4e4b-be9e-6d0cdaa86d5f tempest-AttachVolumeNegativeTest-1325674848 None] Lock "cinder-0f931807-a085-47c3-a802-3374f2b59a5e-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] Acquiring lock "cinder-13424f92-23f4-44ec-8003-f7ccb20affd9-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] Lock "cinder-13424f92-23f4-44ec-8003-f7ccb20affd9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] Acquiring lock "cinder-quobyte-13424f92-23f4-44ec-8003-f7ccb20affd9" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] Lock "cinder-quobyte-13424f92-23f4-44ec-8003-f7ccb20affd9" acquired by "delete_volume" :: waited 0.025s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[f996e9fd-13fd-4d0e-85a6-40fa35050053]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-13424f92-23f4-44ec-8003-f7ccb20affd9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:56 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-13424f92-23f4-44ec-8003-f7ccb20affd9 Jul 21 19:06:56 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "cinder-0de4b377-d849-47a2-994f-eb0e207230b9-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] Lock "cinder-0de4b377-d849-47a2-994f-eb0e207230b9-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:56 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:06:56 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Flow 'volume_create_manager' (14e0d3f7-d452-4db3-925c-a73d603373dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb271cd3-c477-4e2d-85b4-6ccd222a114b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:56 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "cinder-quobyte-0de4b377-d849-47a2-994f-eb0e207230b9" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-13424f92-23f4-44ec-8003-f7ccb20affd9" returned: 0 in 0.780s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-13424f92-23f4-44ec-8003-f7ccb20affd9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb271cd3-c477-4e2d-85b4-6ccd222a114b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1994796231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4df197b-5613-4b66-89cf-0e40fda04850,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ba6f1691b99420eb3fb52ced633e31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:57Z,use_quota=True,user_id='4b9ad6fc6cb548ffaf89cf014d67378e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:57 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-13424f92-23f4-44ec-8003-f7ccb20affd9 Jul 21 19:06:57 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b13654c-e7c3-412b-baba-9c7c09ea07c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b13654c-e7c3-412b-baba-9c7c09ea07c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941e3c4a-c253-4c6d-9036-e75c00500d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941e3c4a-c253-4c6d-9036-e75c00500d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4df197b-5613-4b66-89cf-0e40fda04850', 'volume_name': 'volume-b4df197b-5613-4b66-89cf-0e40fda04850', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c8337a-7c84-4cb1-ba26-ce52457dd39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c8337a-7c84-4cb1-ba26-ce52457dd39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed691fc-cc6f-4eaf-a764-c61d3d14657e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:57 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Volume b4df197b-5613-4b66-89cf-0e40fda04850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4df197b-5613-4b66-89cf-0e40fda04850', 'volume_size': 1} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1994796231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4df197b-5613-4b66-89cf-0e40fda04850,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ba6f1691b99420eb3fb52ced633e31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:06:57Z,use_quota=True,user_id='4b9ad6fc6cb548ffaf89cf014d67378e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Creating volume b4df197b-5613-4b66-89cf-0e40fda04850 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:57 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b4df197b-5613-4b66-89cf-0e40fda04850 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] Lock "cinder-quobyte-0de4b377-d849-47a2-994f-eb0e207230b9" acquired by "delete_volume" :: waited 0.130s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:06:57 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b4df197b-5613-4b66-89cf-0e40fda04850 1073741824 Jul 21 19:06:57 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e718096-4974-45eb-829d-53b558af05cb]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0de4b377-d849-47a2-994f-eb0e207230b9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:57 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.431s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:06:57 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0de4b377-d849-47a2-994f-eb0e207230b9 Jul 21 19:06:57 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:57 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-13424f92-23f4-44ec-8003-f7ccb20affd9" returned: 0 in 0.484s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] Lock "cinder-quobyte-13424f92-23f4-44ec-8003-f7ccb20affd9" released by "delete_volume" :: held 1.361s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] Created reservations ['10e8cb10-d779-4f4f-a16a-dad10f2d7184', '24ffeef4-1135-4c6f-81c1-8c811ad03077', '293008ec-caa6-41ed-b927-76e60dd1f75e', '556c449d-cdaa-49a1-81b4-3bca5ed036b6'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:57 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:06:57 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:57 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0de4b377-d849-47a2-994f-eb0e207230b9" returned: 0 in 0.590s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0de4b377-d849-47a2-994f-eb0e207230b9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:57 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0de4b377-d849-47a2-994f-eb0e207230b9 Jul 21 19:06:57 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:57 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b4df197b-5613-4b66-89cf-0e40fda04850 1073741824" returned: 0 in 0.770s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b4df197b-5613-4b66-89cf-0e40fda04850 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:57 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b4df197b-5613-4b66-89cf-0e40fda04850 Jul 21 19:06:57 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:58 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.398s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:58 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] Deleted volume successfully. Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-35ec8615-77c3-4d8d-ba8b-ecb212f5f153 tempest-VolumesMetadataTest-1247669069 None] Lock "cinder-13424f92-23f4-44ec-8003-f7ccb20affd9-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:58 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0de4b377-d849-47a2-994f-eb0e207230b9" returned: 0 in 0.469s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] Lock "cinder-quobyte-0de4b377-d849-47a2-994f-eb0e207230b9" released by "delete_volume" :: held 1.152s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:58 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b4df197b-5613-4b66-89cf-0e40fda04850" returned: 0 in 0.349s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed691fc-cc6f-4eaf-a764-c61d3d14657e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4df197b-5613-4b66-89cf-0e40fda04850', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e60fbb-61da-47af-bd93-a5dbf813228e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:58 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Volume volume-b4df197b-5613-4b66-89cf-0e40fda04850 (b4df197b-5613-4b66-89cf-0e40fda04850): created successfully Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e60fbb-61da-47af-bd93-a5dbf813228e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Flow 'volume_create_manager' (14e0d3f7-d452-4db3-925c-a73d603373dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:58 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-76e33079-788b-4849-a1a0-ed3ef09bf0b2 tempest-VolumesTestJSON-301519497 None] Created volume successfully. Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] Created reservations ['b3022b61-7570-4b9d-ac92-f07e48d4c22a', '9971e8e0-9edc-4fe0-bc31-af8353deb960', '5af52501-3c45-440a-b61a-078c4b0cbc13', '4ba5f3d1-8ddd-4ce7-a616-b1ff78db6adb'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:58 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:06:58 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:58 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.300s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:06:58 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] Deleted volume successfully. Jul 21 19:06:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-173d0c09-ee8d-47b3-8416-4ed84e345a43 tempest-AttachVolumeNegativeTest-1325674848 None] Lock "cinder-0de4b377-d849-47a2-994f-eb0e207230b9-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Flow 'volume_create_manager' (62763e9a-e08d-4265-a8f5-2501332104db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eff57a9-df85-4202-9840-395f97c552e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eff57a9-df85-4202-9840-395f97c552e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1050276977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2063637e-6631-4048-bd84-289c18446e6f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ba6f1691b99420eb3fb52ced633e31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:00Z,use_quota=True,user_id='4b9ad6fc6cb548ffaf89cf014d67378e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f54215-ea81-4ebe-9d5b-f848b332006c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f54215-ea81-4ebe-9d5b-f848b332006c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac879414-9890-4562-86a2-a3d5f64b6d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac879414-9890-4562-86a2-a3d5f64b6d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2063637e-6631-4048-bd84-289c18446e6f', 'volume_name': 'volume-2063637e-6631-4048-bd84-289c18446e6f', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50cb990-a7eb-468e-979e-d9de8fc593e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50cb990-a7eb-468e-979e-d9de8fc593e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c506c2b-7e65-48f4-88b8-0b757bf0ef91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:06:59 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Volume 2063637e-6631-4048-bd84-289c18446e6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2063637e-6631-4048-bd84-289c18446e6f', 'volume_size': 1} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1050276977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2063637e-6631-4048-bd84-289c18446e6f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ba6f1691b99420eb3fb52ced633e31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:00Z,use_quota=True,user_id='4b9ad6fc6cb548ffaf89cf014d67378e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Creating volume 2063637e-6631-4048-bd84-289c18446e6f {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:06:59 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:06:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2063637e-6631-4048-bd84-289c18446e6f 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:59 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2063637e-6631-4048-bd84-289c18446e6f 1073741824 Jul 21 19:06:59 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:00 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2063637e-6631-4048-bd84-289c18446e6f 1073741824" returned: 0 in 0.598s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2063637e-6631-4048-bd84-289c18446e6f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:00 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2063637e-6631-4048-bd84-289c18446e6f Jul 21 19:07:00 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:00 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2063637e-6631-4048-bd84-289c18446e6f" returned: 0 in 0.388s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c506c2b-7e65-48f4-88b8-0b757bf0ef91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2063637e-6631-4048-bd84-289c18446e6f', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c468078c-6891-4b73-af8e-036d9e155778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:00 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Volume volume-2063637e-6631-4048-bd84-289c18446e6f (2063637e-6631-4048-bd84-289c18446e6f): created successfully Jul 21 19:07:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c468078c-6891-4b73-af8e-036d9e155778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Flow 'volume_create_manager' (62763e9a-e08d-4265-a8f5-2501332104db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:00 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-edca8b90-ed9b-455e-b3c0-251702250aa2 tempest-VolumesTestJSON-301519497 None] Created volume successfully. Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Flow 'volume_create_manager' (f4a5bdc6-55d5-4adf-9cf0-4521440d09db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc003712-5436-43eb-a93f-5d73fa388a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc003712-5436-43eb-a93f-5d73fa388a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1084339680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2726575-287d-4776-ac08-87fe39022770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f749003d2c0f42419acdaf9990013962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:03Z,use_quota=True,user_id='11b26e7f3f3e47db8ee6066a13fe8a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4d6d26-3bd3-4730-b266-388214404b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4d6d26-3bd3-4730-b266-388214404b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2046ad46-6135-4b3c-ba38-d4ee8990a132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2046ad46-6135-4b3c-ba38-d4ee8990a132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2726575-287d-4776-ac08-87fe39022770', 'volume_name': 'volume-d2726575-287d-4776-ac08-87fe39022770', 'volume_size': 2}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec3a2a05-4a6f-4d6f-b761-35a3e08bd4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec3a2a05-4a6f-4d6f-b761-35a3e08bd4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8d495d-c76c-49c3-b64d-4ced649b3c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:02 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Volume d2726575-287d-4776-ac08-87fe39022770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2726575-287d-4776-ac08-87fe39022770', 'volume_size': 2} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1084339680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2726575-287d-4776-ac08-87fe39022770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f749003d2c0f42419acdaf9990013962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:03Z,use_quota=True,user_id='11b26e7f3f3e47db8ee6066a13fe8a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Creating volume d2726575-287d-4776-ac08-87fe39022770 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:02 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:07:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d2726575-287d-4776-ac08-87fe39022770 2147483648 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:02 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d2726575-287d-4776-ac08-87fe39022770 2147483648 Jul 21 19:07:02 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] Acquiring lock "cinder-2063637e-6631-4048-bd84-289c18446e6f-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] Lock "cinder-2063637e-6631-4048-bd84-289c18446e6f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] Acquiring lock "cinder-quobyte-2063637e-6631-4048-bd84-289c18446e6f" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] Lock "cinder-quobyte-2063637e-6631-4048-bd84-289c18446e6f" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:03 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0bd779-5a02-4a25-bee1-fe5e298dd29f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2063637e-6631-4048-bd84-289c18446e6f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:03 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2063637e-6631-4048-bd84-289c18446e6f Jul 21 19:07:03 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:03 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d2726575-287d-4776-ac08-87fe39022770 2147483648" returned: 0 in 0.889s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d2726575-287d-4776-ac08-87fe39022770 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:03 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d2726575-287d-4776-ac08-87fe39022770 Jul 21 19:07:03 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:03 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2063637e-6631-4048-bd84-289c18446e6f" returned: 0 in 0.590s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2063637e-6631-4048-bd84-289c18446e6f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:03 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2063637e-6631-4048-bd84-289c18446e6f Jul 21 19:07:03 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:04 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d2726575-287d-4776-ac08-87fe39022770" returned: 0 in 0.381s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8d495d-c76c-49c3-b64d-4ced649b3c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2726575-287d-4776-ac08-87fe39022770', 'volume_size': 2}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8ba1d4-c121-4afa-a50d-aa27d4113a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:04 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Volume volume-d2726575-287d-4776-ac08-87fe39022770 (d2726575-287d-4776-ac08-87fe39022770): created successfully Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8ba1d4-c121-4afa-a50d-aa27d4113a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Flow 'volume_create_manager' (f4a5bdc6-55d5-4adf-9cf0-4521440d09db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:04 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-fe013576-2144-42c6-ad9d-0f088a07f416 tempest-VolumesCloneNegativeTest-1708360301 None] Created volume successfully. Jul 21 19:07:04 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2063637e-6631-4048-bd84-289c18446e6f" returned: 0 in 0.358s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] Lock "cinder-quobyte-2063637e-6631-4048-bd84-289c18446e6f" released by "delete_volume" :: held 1.006s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] Created reservations ['c300f032-0cff-4cb6-b019-8bb96afc5a8b', 'e9d6d307-e6e1-4bf7-a739-d52285546c8e', '98843a2e-8e15-41b3-936b-df9f4bde7bc9', 'ef5b2434-ad7f-44a4-a2cc-1455a763488f'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:04 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:07:04 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:04 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.390s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:04 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] Deleted volume successfully. Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-813fa14b-01e4-45e5-884c-016dbda3ba16 tempest-VolumesTestJSON-301519497 None] Lock "cinder-2063637e-6631-4048-bd84-289c18446e6f-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] Acquiring lock "cinder-d2726575-287d-4776-ac08-87fe39022770-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] Lock "cinder-d2726575-287d-4776-ac08-87fe39022770-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] Acquiring lock "cinder-quobyte-d2726575-287d-4776-ac08-87fe39022770" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] Lock "cinder-quobyte-d2726575-287d-4776-ac08-87fe39022770" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:05 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b15064-cfb6-443a-b5c8-7c56dd2ff995]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d2726575-287d-4776-ac08-87fe39022770 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:05 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d2726575-287d-4776-ac08-87fe39022770 Jul 21 19:07:05 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] Acquiring lock "cinder-b4df197b-5613-4b66-89cf-0e40fda04850-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] Lock "cinder-b4df197b-5613-4b66-89cf-0e40fda04850-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] Acquiring lock "cinder-quobyte-b4df197b-5613-4b66-89cf-0e40fda04850" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] Lock "cinder-quobyte-b4df197b-5613-4b66-89cf-0e40fda04850" acquired by "delete_volume" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:05 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaf985d-627e-4352-8cc3-19f2cf8ecaac]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b4df197b-5613-4b66-89cf-0e40fda04850 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:05 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d2726575-287d-4776-ac08-87fe39022770" returned: 0 in 0.685s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d2726575-287d-4776-ac08-87fe39022770 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:05 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d2726575-287d-4776-ac08-87fe39022770 Jul 21 19:07:05 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:05 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b4df197b-5613-4b66-89cf-0e40fda04850 Jul 21 19:07:05 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:06 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d2726575-287d-4776-ac08-87fe39022770" returned: 0 in 0.346s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] Lock "cinder-quobyte-d2726575-287d-4776-ac08-87fe39022770" released by "delete_volume" :: held 1.115s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=85,cinder:UPDATE=94,cinder:INSERT=18,cinder:DELETE=12 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] Created reservations ['ff1ac6d2-3b47-4169-b738-f4220e9dea7b', 'ee063fa3-960b-42ed-9213-ffbb6b305228', 'bf81baeb-9b4f-431f-9eba-66bf79524923', '657852e2-a50a-4326-ace8-48f4925e8396'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:06 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b4df197b-5613-4b66-89cf-0e40fda04850" returned: 0 in 0.619s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b4df197b-5613-4b66-89cf-0e40fda04850 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:06 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b4df197b-5613-4b66-89cf-0e40fda04850 Jul 21 19:07:06 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:06 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:07:06 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:06 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.301s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:06 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] Deleted volume successfully. Jul 21 19:07:06 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=118,cinder:SELECT=88,cinder:DELETE=7,cinder:INSERT=29 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b4df197b-5613-4b66-89cf-0e40fda04850" returned: 0 in 0.361s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] Lock "cinder-quobyte-b4df197b-5613-4b66-89cf-0e40fda04850" released by "delete_volume" :: held 1.047s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bae6c08d-c9a3-49bf-b07a-e8bfe36cc20a tempest-VolumesCloneNegativeTest-1708360301 None] Lock "cinder-d2726575-287d-4776-ac08-87fe39022770-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] Created reservations ['20ccef01-3a09-4f5f-b05e-6ae3eec9aa3a', '7a1ac8c0-80cd-4a58-9e30-17f82d4dfc0c', '04bb7f0e-a9de-492a-9f93-149aaf546783', 'f82331c5-8fd1-43c8-af04-5ea6bf2d27c0'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:06 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:07:06 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] Acquiring lock "cinder-552945d2-3f51-442c-86c7-42e13b9aa319-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] Lock "cinder-552945d2-3f51-442c-86c7-42e13b9aa319-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] Acquiring lock "cinder-quobyte-552945d2-3f51-442c-86c7-42e13b9aa319" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] Lock "cinder-quobyte-552945d2-3f51-442c-86c7-42e13b9aa319" acquired by "delete_volume" :: waited 0.024s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:07 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8579a27-00c3-4353-b258-4579bf9b0301]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-552945d2-3f51-442c-86c7-42e13b9aa319 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:07 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-552945d2-3f51-442c-86c7-42e13b9aa319 Jul 21 19:07:07 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:07 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.408s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:07 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:07 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] Deleted volume successfully. Jul 21 19:07:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5fab83e2-84ee-4b2f-b8b2-20c372a3e7cd tempest-VolumesTestJSON-301519497 None] Lock "cinder-b4df197b-5613-4b66-89cf-0e40fda04850-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:07 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-552945d2-3f51-442c-86c7-42e13b9aa319" returned: 0 in 0.475s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-552945d2-3f51-442c-86c7-42e13b9aa319 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:07 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-552945d2-3f51-442c-86c7-42e13b9aa319 Jul 21 19:07:07 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:07 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-552945d2-3f51-442c-86c7-42e13b9aa319" returned: 0 in 0.265s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] Lock "cinder-quobyte-552945d2-3f51-442c-86c7-42e13b9aa319" released by "delete_volume" :: held 0.792s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:07 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] Created reservations ['90e7b7f8-34b3-4c31-b6a9-334119b294c4', '47a9bae2-062b-4436-bb3b-c4f691b067fb', 'f4990bbb-f187-4c91-8324-e8591109d901', '5f3773fc-046c-4cf4-a34c-df5e28091486'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:08 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:07:08 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:08 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.384s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:08 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:08 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] Deleted volume successfully. Jul 21 19:07:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-908b0503-eee9-4e96-8cef-5150f213cbc1 tempest-VolumesTestJSON-301519497 None] Lock "cinder-552945d2-3f51-442c-86c7-42e13b9aa319-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:12 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Flow 'volume_create_manager' (6e7dc075-350c-44b2-ad83-00262940d72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc84121-55c3-4439-a2ff-3d3f75120878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc84121-55c3-4439-a2ff-3d3f75120878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1169381440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2a1149-e9d6-4a8b-898f-62997d6b8c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1e2a2ab694a5b81fc14175131f536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:12Z,use_quota=True,user_id='70e37531cb9b47fe8e7c7fa0b1e79623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec1bf58-7ccb-405c-8bbf-0d8d20defbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec1bf58-7ccb-405c-8bbf-0d8d20defbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00a6ce7-0b7c-4d4a-ae42-198ad67d410a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:12 devstack cinder-volume[87570]: DEBUG cinder.image.glance [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Creating Keystone auth plugin from conf {{(pid=87570) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:07:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00a6ce7-0b7c-4d4a-ae42-198ad67d410a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd2a1149-e9d6-4a8b-898f-62997d6b8c44', 'volume_name': 'volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44', 'volume_size': 1, 'image_id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d5947bfd6bf45059ad4d24acd0d802c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'created_at': datetime.datetime(2026, 7, 21, 16, 54, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f91a19b-d3e5-4cd6-81da-f941115b9221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f91a19b-d3e5-4cd6-81da-f941115b9221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad52275-e081-4fdf-afeb-5bd87df8851f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:12 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Volume fd2a1149-e9d6-4a8b-898f-62997d6b8c44: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44', 'volume_size': 1, 'image_id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d5947bfd6bf45059ad4d24acd0d802c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'created_at': datetime.datetime(2026, 7, 21, 16, 54, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 19:07:12 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Trying to clone fd2a1149-e9d6-4a8b-898f-62997d6b8c44 from image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}]). {{(pid=87570) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:07:13 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_1brgook8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:07:13 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Image download 20.69 MB at 20.69 MB/s Jul 21 19:07:13 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[6206dc57-c56a-4f84-b442-1bbe43e0de57]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_1brgook8devstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:13 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_1brgook8devstack@QuobyteHD Jul 21 19:07:13 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:14 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_1brgook8devstack@QuobyteHD" returned: 0 in 0.489s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:14 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Temporary image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 is fetched for user 70e37531cb9b47fe8e7c7fa0b1e79623. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:07:14 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e049199-e04b-4e40-9a9e-dd2bc3a394fa]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_1brgook8devstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:14 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-663992cf-5301-4a5e-9f5a-4833722c1801 tempest-GroupSnapshotsV319Test-90097868 None] Group tempest-GroupSnapshotsV319Test-Group-745649480: creating Jul 21 19:07:14 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-663992cf-5301-4a5e-9f5a-4833722c1801 tempest-GroupSnapshotsV319Test-90097868 None] Group tempest-GroupSnapshotsV319Test-Group-745649480: created successfully Jul 21 19:07:14 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-663992cf-5301-4a5e-9f5a-4833722c1801 tempest-GroupSnapshotsV319Test-90097868 None] Create group completed successfully. Jul 21 19:07:14 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_1brgook8devstack@QuobyteHD Jul 21 19:07:14 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:14 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_1brgook8devstack@QuobyteHD" returned: 0 in 0.650s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1169381440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2a1149-e9d6-4a8b-898f-62997d6b8c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1e2a2ab694a5b81fc14175131f536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:12Z,use_quota=True,user_id='70e37531cb9b47fe8e7c7fa0b1e79623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Creating volume fd2a1149-e9d6-4a8b-898f-62997d6b8c44 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:15 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:15 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:15 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:07:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:15 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 1073741824 Jul 21 19:07:15 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:15 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 1073741824" returned: 0 in 0.699s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:15 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 Jul 21 19:07:15 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:16 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44" returned: 0 in 0.304s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Attempting download of 2235c2cf-4cba-41d7-9e54-acfbf60b7351 ((None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}])) to volume fd2a1149-e9d6-4a8b-898f-62997d6b8c44. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[b226478a-d0ea-4fb1-b8f1-6318ab4088e8]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_gsaeu1jw {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:16 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_gsaeu1jw Jul 21 19:07:16 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Flow 'volume_create_manager' (c94e1c9b-9be4-44fa-a902-13edccacb130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cf516f-b6de-49c7-a490-b4c8232892d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cf516f-b6de-49c7-a490-b4c8232892d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1212753351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49faecec-6a70-44e3-bbab-36d9ebcc2e38,host='devstack@QuobyteHD#QuobyteHD',id=3578148c-e99b-4baa-946d-606a0ffd8e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f9dd80652124bb9bebf4a5ac231f403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:17Z,use_quota=True,user_id='0b33dc250d2e4c878939f368c3a1fe00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7aad9af1-9828-44e7-a8cc-29c6ff5b3919),volume_type_id=7aad9af1-9828-44e7-a8cc-29c6ff5b3919)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed893db4-36e4-4031-90d4-0b88cd9a2f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed893db4-36e4-4031-90d4-0b88cd9a2f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775399e9-5005-4c14-ac74-e789411f9817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775399e9-5005-4c14-ac74-e789411f9817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3578148c-e99b-4baa-946d-606a0ffd8e27', 'volume_name': 'volume-3578148c-e99b-4baa-946d-606a0ffd8e27', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b57ba9-7832-447a-b5d3-68ea4185e1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b57ba9-7832-447a-b5d3-68ea4185e1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f03df5-72c4-4c0e-ac9c-7e70d50bacd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:16 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Volume 3578148c-e99b-4baa-946d-606a0ffd8e27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3578148c-e99b-4baa-946d-606a0ffd8e27', 'volume_size': 1} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=49faecec-6a70-44e3-bbab-36d9ebcc2e38,created_at=2026-07-21T17:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1212753351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49faecec-6a70-44e3-bbab-36d9ebcc2e38,host='devstack@QuobyteHD#QuobyteHD',id=3578148c-e99b-4baa-946d-606a0ffd8e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f9dd80652124bb9bebf4a5ac231f403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:17Z,use_quota=True,user_id='0b33dc250d2e4c878939f368c3a1fe00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7aad9af1-9828-44e7-a8cc-29c6ff5b3919),volume_type_id=7aad9af1-9828-44e7-a8cc-29c6ff5b3919)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Creating volume 3578148c-e99b-4baa-946d-606a0ffd8e27 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:16 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:16 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27 1073741824 Jul 21 19:07:16 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:16 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_gsaeu1jw" returned: 0 in 0.695s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_gsaeu1jw {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:17 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_gsaeu1jw Jul 21 19:07:17 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:17 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_gsaeu1jw" returned: 1 in 0.484s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_gsaeu1jw' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:07:17 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed058621-b7ce-4b07-838c-4df1f55010e4]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_1brgook8devstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:17 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27 1073741824" returned: 0 in 0.759s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:17 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_1brgook8devstack@QuobyteHD Jul 21 19:07:17 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:17 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27 Jul 21 19:07:17 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:17 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_1brgook8devstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:17 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] 2235c2cf-4cba-41d7-9e54-acfbf60b7351 was qcow2, converting to qcow2 {{(pid=87570) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:07:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_1brgook8devstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:17 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_1brgook8devstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 Jul 21 19:07:17 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:18 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27" returned: 0 in 0.517s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f03df5-72c4-4c0e-ac9c-7e70d50bacd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3578148c-e99b-4baa-946d-606a0ffd8e27', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2a4ba0-9281-422c-9ee6-96a4719399a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:18 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Volume volume-3578148c-e99b-4baa-946d-606a0ffd8e27 (3578148c-e99b-4baa-946d-606a0ffd8e27): created successfully Jul 21 19:07:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2a4ba0-9281-422c-9ee6-96a4719399a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Flow 'volume_create_manager' (c94e1c9b-9be4-44fa-a902-13edccacb130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:18 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-538e7168-1753-4f9e-a386-90a5230f2136 tempest-GroupSnapshotsV319Test-90097868 None] Created volume successfully. Jul 21 19:07:19 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] GroupSnapshot 5b3197ed-5468-449d-8034-4f64162d6e49: creating. Jul 21 19:07:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] Group snapshot 5b3197ed-5468-449d-8034-4f64162d6e49: creating. {{(pid=87570) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 19:07:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:19 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] Creating offline snapshot 86b879c3-567c-4270-b799-c640704b4710 of volume 3578148c-e99b-4baa-946d-606a0ffd8e27 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:07:19 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[572cd28d-1ff4-4bab-a6a5-ac94fcd3cf56]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:20 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27 Jul 21 19:07:20 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:20 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_1brgook8devstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44" returned: 0 in 2.501s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:20 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_1brgook8devstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:07:20 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Converted 112.00 MB image at 44.70 MB/s Jul 21 19:07:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:20 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 1G Jul 21 19:07:20 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:20 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27" returned: 0 in 0.651s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:20 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710 1G Jul 21 19:07:20 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:20 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 1G" returned: 0 in 0.513s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:20 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Downloaded image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 ((None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}])) to volume fd2a1149-e9d6-4a8b-898f-62997d6b8c44 successfully. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:07:20 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Temporary image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 for user 70e37531cb9b47fe8e7c7fa0b1e79623 is deleted. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:07:20 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Marking volume fd2a1149-e9d6-4a8b-898f-62997d6b8c44 as bootable. {{(pid=87570) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:07:20 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Copying metadata from image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 to fd2a1149-e9d6-4a8b-898f-62997d6b8c44. {{(pid=87570) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:07:20 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Creating volume glance metadata for volume fd2a1149-e9d6-4a8b-898f-62997d6b8c44 backed by image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87570) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:07:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad52275-e081-4fdf-afeb-5bd87df8851f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44', 'volume_size': 1, 'image_id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d5947bfd6bf45059ad4d24acd0d802c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'created_at': datetime.datetime(2026, 7, 21, 16, 54, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0256cf-efa1-4828-bd09-ad3a98a94f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:21 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Volume volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 (fd2a1149-e9d6-4a8b-898f-62997d6b8c44): created successfully Jul 21 19:07:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0256cf-efa1-4828-bd09-ad3a98a94f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Flow 'volume_create_manager' (6e7dc075-350c-44b2-ad83-00262940d72f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:21 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-2fcfd17a-c473-4d80-95cb-8e18aa38c2bf tempest-VolumesExtendTest-335062433 None] Created volume successfully. Jul 21 19:07:21 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710 1G" returned: 0 in 0.646s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3578148c-e99b-4baa-946d-606a0ffd8e27 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:21 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3578148c-e99b-4baa-946d-606a0ffd8e27 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710 Jul 21 19:07:21 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:21 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3578148c-e99b-4baa-946d-606a0ffd8e27 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710" returned: 0 in 0.306s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:21 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:07:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:21 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710 Jul 21 19:07:21 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:21 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710" returned: 0 in 0.243s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:21 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.info Jul 21 19:07:21 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:22 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.info" returned: 0 in 0.348s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:22 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:07:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:22 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.info Jul 21 19:07:22 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8084e67c-9334-40ba-b171-70bb0ab6a69e tempest-VolumesExtendTest-335062433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:22 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.info" returned: 0 in 0.305s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.595s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8084e67c-9334-40ba-b171-70bb0ab6a69e tempest-VolumesExtendTest-335062433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.113s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:22 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc1ae1a-5fdf-4fd6-9dc1-17eea2476236]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8084e67c-9334-40ba-b171-70bb0ab6a69e tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:22 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-97565913-579b-4be8-939f-99f1372db982 tempest-GroupSnapshotsV319Test-90097868 None] group_snapshot 5b3197ed-5468-449d-8034-4f64162d6e49: created successfully Jul 21 19:07:22 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 Jul 21 19:07:22 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:22 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8084e67c-9334-40ba-b171-70bb0ab6a69e tempest-VolumesExtendTest-335062433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44" returned: 0 in 0.396s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8084e67c-9334-40ba-b171-70bb0ab6a69e tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 2G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8084e67c-9334-40ba-b171-70bb0ab6a69e tempest-VolumesExtendTest-335062433 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 2G" returned: 0 in 0.109s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8084e67c-9334-40ba-b171-70bb0ab6a69e tempest-VolumesExtendTest-335062433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.541s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:23 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8084e67c-9334-40ba-b171-70bb0ab6a69e tempest-VolumesExtendTest-335062433 None] Extend volume completed successfully. Jul 21 19:07:23 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-359b58c3-b78d-4e0f-ba7d-8bf94d267a78 tempest-GroupsTest-1633385476 None] Group tempest-Group1-1662558766: creating Jul 21 19:07:23 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-359b58c3-b78d-4e0f-ba7d-8bf94d267a78 tempest-GroupsTest-1633385476 None] Group tempest-Group1-1662558766: created successfully Jul 21 19:07:23 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-359b58c3-b78d-4e0f-ba7d-8bf94d267a78 tempest-GroupsTest-1633385476 None] Create group completed successfully. Jul 21 19:07:23 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] group_snapshot 5b3197ed-5468-449d-8034-4f64162d6e49: deleting Jul 21 19:07:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] group_snapshot 5b3197ed-5468-449d-8034-4f64162d6e49: deleting {{(pid=87570) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 19:07:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] Acquiring lock "cinder-quobyte-3578148c-e99b-4baa-946d-606a0ffd8e27" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] Lock "cinder-quobyte-3578148c-e99b-4baa-946d-606a0ffd8e27" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] Acquiring lock "cinder-quobyte-86b879c3-567c-4270-b799-c640704b4710" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] Lock "cinder-quobyte-86b879c3-567c-4270-b799-c640704b4710" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] Deleting offline snapshot 86b879c3-567c-4270-b799-c640704b4710 of volume 3578148c-e99b-4baa-946d-606a0ffd8e27 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:07:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] snapshot_file for this snap is: volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:07:23 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c119925-2e33-4d7f-86ca-c60be7c337de]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] Acquiring lock "cinder-fd2a1149-e9d6-4a8b-898f-62997d6b8c44-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] Lock "cinder-fd2a1149-e9d6-4a8b-898f-62997d6b8c44-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] Acquiring lock "cinder-quobyte-fd2a1149-e9d6-4a8b-898f-62997d6b8c44" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] Lock "cinder-quobyte-fd2a1149-e9d6-4a8b-898f-62997d6b8c44" acquired by "delete_volume" :: waited 0.033s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:23 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710 Jul 21 19:07:23 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:23 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db6a857-4502-42cb-b6d8-1220a172393e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:24 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 Jul 21 19:07:24 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:24 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710" returned: 0 in 0.542s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3578148c-e99b-4baa-946d-606a0ffd8e27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:07:24 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1324ed-0b92-476e-a36a-45b08aea0de7]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:24 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44" returned: 0 in 0.435s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:24 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44 Jul 21 19:07:24 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:24 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27 Jul 21 19:07:24 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:24 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-55ac2bbf-6153-4763-b171-22a83cabb7a4 tempest-GroupsTest-1633385476 None] Group tempest-Group2-953582425: creating Jul 21 19:07:24 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fd2a1149-e9d6-4a8b-898f-62997d6b8c44" returned: 0 in 0.349s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] Lock "cinder-quobyte-fd2a1149-e9d6-4a8b-898f-62997d6b8c44" released by "delete_volume" :: held 0.839s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:24 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-55ac2bbf-6153-4763-b171-22a83cabb7a4 tempest-GroupsTest-1633385476 None] Group tempest-Group2-953582425: created successfully Jul 21 19:07:24 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-55ac2bbf-6153-4763-b171-22a83cabb7a4 tempest-GroupsTest-1633385476 None] Create group completed successfully. Jul 21 19:07:24 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] Created reservations ['175ce088-0ab0-4135-83f2-3a712080c151', 'be94f564-c9a5-42bc-92bf-6f33e7726899', 'd1d32ff5-9552-41c0-871d-1a250314c8c8', 'e87c6aa9-ba6b-4f32-8d00-99e5a4acb03d'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:24 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27" returned: 0 in 0.604s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:24 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:07:24 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:24 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710 Jul 21 19:07:24 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:25 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.311s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:25 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] Deleted volume successfully. Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3270909a-6b2e-4845-a9ef-933b5a43c297 tempest-VolumesExtendTest-335062433 None] Lock "cinder-fd2a1149-e9d6-4a8b-898f-62997d6b8c44-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:25 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710" returned: 0 in 0.438s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:25 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710 Jul 21 19:07:25 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:25 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Flow 'volume_create_manager' (68fbd5d0-9e3e-4b5c-85ae-68d4973ae2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8519da-bfd3-4d5c-901e-22ff4cf3f6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27.86b879c3-567c-4270-b799-c640704b4710" returned: 0 in 0.321s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8519da-bfd3-4d5c-901e-22ff4cf3f6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-464396239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a495c4-c106-4ddd-9249-283bb199a2b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1e2a2ab694a5b81fc14175131f536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:26Z,use_quota=True,user_id='70e37531cb9b47fe8e7c7fa0b1e79623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e4a837-7334-4201-bde4-5a3c0ebe52e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e4a837-7334-4201-bde4-5a3c0ebe52e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1b5b8b-7c8a-4595-9243-6889fd58fc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1b5b8b-7c8a-4595-9243-6889fd58fc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70a495c4-c106-4ddd-9249-283bb199a2b9', 'volume_name': 'volume-70a495c4-c106-4ddd-9249-283bb199a2b9', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58219a4c-c888-44d8-933e-b95756e1a7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58219a4c-c888-44d8-933e-b95756e1a7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3017d13-2f45-4d7f-87ee-b3e3646ed992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:25 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Volume 70a495c4-c106-4ddd-9249-283bb199a2b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70a495c4-c106-4ddd-9249-283bb199a2b9', 'volume_size': 1} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-464396239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a495c4-c106-4ddd-9249-283bb199a2b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1e2a2ab694a5b81fc14175131f536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:26Z,use_quota=True,user_id='70e37531cb9b47fe8e7c7fa0b1e79623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Creating volume 70a495c4-c106-4ddd-9249-283bb199a2b9 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:25 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] Lock "cinder-quobyte-86b879c3-567c-4270-b799-c640704b4710" released by "_delete_snapshot" :: held 2.103s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] Lock "cinder-quobyte-3578148c-e99b-4baa-946d-606a0ffd8e27" released by "delete_snapshot" :: held 2.145s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:25 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9 1073741824 Jul 21 19:07:25 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:25 devstack cinder-volume[87570]: WARNING cinder.quota [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-888172188 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-888172188, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:07:25 devstack cinder-volume[87570]: WARNING cinder.quota [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-888172188 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-888172188, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:07:25 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] Created reservations ['be0e80e4-dec6-4f6f-b902-a36955e4f634', 'f433020b-9947-4d20-8732-f9341de9ae55', '9d7f8314-e5ef-435e-8345-88543cf34064', '08c2147a-c058-4908-9483-2c0915f7d04e'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:26 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f6c8a275-b7cd-488b-97e0-7a32f7cf78e3 tempest-GroupSnapshotsV319Test-90097868 None] group_snapshot 5b3197ed-5468-449d-8034-4f64162d6e49: deleted successfully Jul 21 19:07:26 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9 1073741824" returned: 0 in 0.729s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Flow 'volume_create_manager' (99d56ed7-9a11-4336-8bb6-2413bf80c0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b6e2d4-3bd2-4d33-9f33-cda2bd073532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b6e2d4-3bd2-4d33-9f33-cda2bd073532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1257095287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=de0a2f6c-9ec9-45c4-a343-d6ff89a40682,host='devstack@QuobyteHD#QuobyteHD',id=3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4e3f9fad604b189674a73c48324b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:26Z,use_quota=True,user_id='0079a6c592a14ad3a34a52245567ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d1a07cc-7325-43f9-8151-6c72257d6545),volume_type_id=6d1a07cc-7325-43f9-8151-6c72257d6545)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c335d58-3179-48f0-bca8-0a9e4216ac5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c335d58-3179-48f0-bca8-0a9e4216ac5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a57b6b-d85c-4b5d-81b9-a56118dc4b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a57b6b-d85c-4b5d-81b9-a56118dc4b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842', 'volume_name': 'volume-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9a2dd9-aac4-4a25-8ab4-d400e1c4a7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9a2dd9-aac4-4a25-8ab4-d400e1c4a7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e0e3cd-1670-46e4-a243-493eb3db6af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:26 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Volume 3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842', 'volume_size': 1} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:26 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9 Jul 21 19:07:26 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:26 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9" returned: 0 in 0.302s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.317s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=de0a2f6c-9ec9-45c4-a343-d6ff89a40682,created_at=2026-07-21T17:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1257095287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=de0a2f6c-9ec9-45c4-a343-d6ff89a40682,host='devstack@QuobyteHD#QuobyteHD',id=3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4e3f9fad604b189674a73c48324b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:26Z,use_quota=True,user_id='0079a6c592a14ad3a34a52245567ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d1a07cc-7325-43f9-8151-6c72257d6545),volume_type_id=6d1a07cc-7325-43f9-8151-6c72257d6545)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Creating volume 3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:26 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3017d13-2f45-4d7f-87ee-b3e3646ed992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a495c4-c106-4ddd-9249-283bb199a2b9', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2f54c1-c07e-4714-ab82-59a10428e97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:27 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842 1073741824 Jul 21 19:07:27 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:27 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Volume volume-70a495c4-c106-4ddd-9249-283bb199a2b9 (70a495c4-c106-4ddd-9249-283bb199a2b9): created successfully Jul 21 19:07:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2f54c1-c07e-4714-ab82-59a10428e97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Flow 'volume_create_manager' (68fbd5d0-9e3e-4b5c-85ae-68d4973ae2fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:27 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-b46a4397-f851-457d-836f-a61ac053e8d0 tempest-VolumesExtendTest-335062433 None] Created volume successfully. Jul 21 19:07:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] Acquiring lock "cinder-quobyte-3578148c-e99b-4baa-946d-606a0ffd8e27" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] Lock "cinder-quobyte-3578148c-e99b-4baa-946d-606a0ffd8e27" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:27 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1fe5d3-b79f-4904-86dc-cc6ac6d3210b]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:27 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842 1073741824" returned: 0 in 0.615s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:27 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27 Jul 21 19:07:27 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:27 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842 Jul 21 19:07:27 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:27 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27" returned: 0 in 0.443s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:28 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27 Jul 21 19:07:28 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:28 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842" returned: 0 in 0.402s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.015s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] Creating offline snapshot 4df477e5-888a-44e5-a907-0e72bbcd3614 of volume 70a495c4-c106-4ddd-9249-283bb199a2b9 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e0e3cd-1670-46e4-a243-493eb3db6af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd291054-159e-4740-8294-dca84ae98f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[c991f369-b330-4a6e-bc19-2305a1bd603d]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:28 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Volume volume-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842 (3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842): created successfully Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd291054-159e-4740-8294-dca84ae98f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Flow 'volume_create_manager' (99d56ed7-9a11-4336-8bb6-2413bf80c0ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:28 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4705af28-8b42-4c87-8172-1fd899fcce65 tempest-GroupsTest-1633385476 None] Created volume successfully. Jul 21 19:07:28 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9 Jul 21 19:07:28 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:28 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3578148c-e99b-4baa-946d-606a0ffd8e27" returned: 0 in 0.332s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] Lock "cinder-quobyte-3578148c-e99b-4baa-946d-606a0ffd8e27" released by "delete_volume" :: held 0.844s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] Created reservations ['9f447998-3c86-4d61-bdc1-acba549052d9'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:28 devstack cinder-volume[87570]: WARNING cinder.quota [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-888172188 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-888172188, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] Created reservations ['6d150462-ae08-49d9-9f4d-cf70ecbb8e1c', '5f482dcb-2519-40b4-9f96-81e381e32d49', '70d10bf3-f8b7-4299-8edf-da4406d29f69', '83b12694-f41d-48a0-a073-5a83bdd8c70f'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:28 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9" returned: 0 in 0.385s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:28 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614 1G Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:28 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:28 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:07:28 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:28 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.257s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:28 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-2168196a-e9b4-4ba1-af8c-6d43533068fc tempest-GroupSnapshotsV319Test-90097868 None] Delete group completed successfully. Jul 21 19:07:28 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614 1G" returned: 0 in 0.469s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70a495c4-c106-4ddd-9249-283bb199a2b9 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:28 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70a495c4-c106-4ddd-9249-283bb199a2b9 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614 Jul 21 19:07:28 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:29 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70a495c4-c106-4ddd-9249-283bb199a2b9 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614" returned: 0 in 0.331s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:29 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614 is being set with open permissions: ugo+rw Jul 21 19:07:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:29 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614 Jul 21 19:07:29 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] Acquiring lock "cinder-quobyte-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:29 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] Lock "cinder-quobyte-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614" returned: 0 in 0.318s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:29 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a91b802-a838-4823-b9d3-778e83fac32a]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:29 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.info Jul 21 19:07:29 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:29 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842 Jul 21 19:07:29 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:29 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.info" returned: 0 in 0.294s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:29 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.info is being set with open permissions: ugo+rw Jul 21 19:07:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:30 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.info Jul 21 19:07:30 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:30 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842" returned: 0 in 0.449s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:30 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842 Jul 21 19:07:30 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:30 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.info" returned: 0 in 0.305s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.233s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:30 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-24254a8b-05ab-446c-a50f-d2e7430816f5 tempest-VolumesExtendTest-335062433 None] Create snapshot completed successfully Jul 21 19:07:30 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842" returned: 0 in 0.276s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] Lock "cinder-quobyte-3db5e1ee-efea-4e7b-9b1a-3bfc0c7c1842" released by "delete_volume" :: held 0.793s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:30 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] Created reservations ['10eed065-f680-492b-89ff-ef9db82f1e8c'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:30 devstack cinder-volume[87570]: WARNING cinder.quota [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-71568443 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-71568443, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:07:30 devstack cinder-volume[87570]: WARNING cinder.quota [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-71568443 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-71568443, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:07:30 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] Created reservations ['2fa3e3df-5866-4f57-b47d-94d40e800ad2', '1873354a-0b60-4204-a108-a7395f6a7089', '6d4e4ea8-c76d-471b-8c5f-79b33162c0f2', '70027bc2-4725-4ecb-aeda-b853745da615'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:30 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:07:30 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:30 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.274s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:30 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:30 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-aa18a06f-3d8d-44d8-a7de-f94e4416d460 tempest-GroupsTest-1633385476 None] Delete group completed successfully. Jul 21 19:07:30 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-26e02470-0a75-4b00-b84b-bc2945753976 tempest-GroupsTest-1633385476 None] Created reservations ['91e1afc6-cc41-457c-81ab-7365514e369e'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-26e02470-0a75-4b00-b84b-bc2945753976 tempest-GroupsTest-1633385476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-26e02470-0a75-4b00-b84b-bc2945753976 tempest-GroupsTest-1633385476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-26e02470-0a75-4b00-b84b-bc2945753976 tempest-GroupsTest-1633385476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-26e02470-0a75-4b00-b84b-bc2945753976 tempest-GroupsTest-1633385476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-26e02470-0a75-4b00-b84b-bc2945753976 tempest-GroupsTest-1633385476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-26e02470-0a75-4b00-b84b-bc2945753976 tempest-GroupsTest-1633385476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:31 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:07:31 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:31 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-26e02470-0a75-4b00-b84b-bc2945753976 tempest-GroupsTest-1633385476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.294s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:31 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-26e02470-0a75-4b00-b84b-bc2945753976 tempest-GroupsTest-1633385476 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:31 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-26e02470-0a75-4b00-b84b-bc2945753976 tempest-GroupsTest-1633385476 None] Delete group completed successfully. Jul 21 19:07:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f16038d6-944c-4ffa-a564-bc970782cefb tempest-VolumesExtendTest-335062433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f16038d6-944c-4ffa-a564-bc970782cefb tempest-VolumesExtendTest-335062433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:31 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b156bed-90cc-4a4e-b1db-c6f64ad371cd]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f16038d6-944c-4ffa-a564-bc970782cefb tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:31 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9 Jul 21 19:07:31 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:31 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f16038d6-944c-4ffa-a564-bc970782cefb tempest-VolumesExtendTest-335062433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9" returned: 0 in 0.399s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f16038d6-944c-4ffa-a564-bc970782cefb tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614 2G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f16038d6-944c-4ffa-a564-bc970782cefb tempest-VolumesExtendTest-335062433 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614 2G" returned: 0 in 0.143s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f16038d6-944c-4ffa-a564-bc970782cefb tempest-VolumesExtendTest-335062433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.580s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:31 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f16038d6-944c-4ffa-a564-bc970782cefb tempest-VolumesExtendTest-335062433 None] Extend volume completed successfully. Jul 21 19:07:32 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8d2faf89-c23f-435c-9af5-53b10d414695 tempest-GroupsTest-1633385476 None] Group tempest-GroupsTest-Group-1084413098: creating Jul 21 19:07:32 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8d2faf89-c23f-435c-9af5-53b10d414695 tempest-GroupsTest-1633385476 None] Group tempest-GroupsTest-Group-1084413098: created successfully Jul 21 19:07:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] Acquiring lock "cinder-4df477e5-888a-44e5-a907-0e72bbcd3614-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:32 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8d2faf89-c23f-435c-9af5-53b10d414695 tempest-GroupsTest-1633385476 None] Create group completed successfully. Jul 21 19:07:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] Lock "cinder-4df477e5-888a-44e5-a907-0e72bbcd3614-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] Acquiring lock "cinder-quobyte-70a495c4-c106-4ddd-9249-283bb199a2b9" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] Lock "cinder-quobyte-70a495c4-c106-4ddd-9249-283bb199a2b9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] Acquiring lock "cinder-quobyte-4df477e5-888a-44e5-a907-0e72bbcd3614" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] Lock "cinder-quobyte-4df477e5-888a-44e5-a907-0e72bbcd3614" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:32 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] Deleting offline snapshot 4df477e5-888a-44e5-a907-0e72bbcd3614 of volume 70a495c4-c106-4ddd-9249-283bb199a2b9 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:07:32 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] snapshot_file for this snap is: volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:07:32 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ca4f7c-50cf-42c5-a0f4-44566f8090e6]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:32 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614 Jul 21 19:07:32 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:33 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614" returned: 0 in 0.379s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70a495c4-c106-4ddd-9249-283bb199a2b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:07:33 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[879634c8-9867-430c-a414-7277e0d1b8a6]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:33 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9 Jul 21 19:07:33 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:33 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9" returned: 0 in 0.373s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:33 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614 Jul 21 19:07:33 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:33 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614" returned: 0 in 0.407s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:33 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614 Jul 21 19:07:33 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:34 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9.4df477e5-888a-44e5-a907-0e72bbcd3614" returned: 0 in 0.302s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] Lock "cinder-quobyte-4df477e5-888a-44e5-a907-0e72bbcd3614" released by "_delete_snapshot" :: held 1.601s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] Lock "cinder-quobyte-70a495c4-c106-4ddd-9249-283bb199a2b9" released by "delete_snapshot" :: held 1.629s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Flow 'volume_create_manager' (434b0d0a-1145-4fbd-8d58-bf06beccc097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc725bb7-1c3a-4d10-a047-e2025f8161aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc725bb7-1c3a-4d10-a047-e2025f8161aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1597421364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99cf1fd4-2d9a-429a-97b1-2d9c623920ad,host='devstack@QuobyteHD#QuobyteHD',id=110fa889-2ae8-401f-87d3-22b037e0a799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4e3f9fad604b189674a73c48324b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:34Z,use_quota=True,user_id='0079a6c592a14ad3a34a52245567ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afc82346-68d2-477f-8e07-a7210d99b8b5),volume_type_id=afc82346-68d2-477f-8e07-a7210d99b8b5)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c0ce38-cfd3-4b7b-827c-305a88f0f968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c0ce38-cfd3-4b7b-827c-305a88f0f968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83cc6d78-2982-4e85-aaa0-811692a21e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83cc6d78-2982-4e85-aaa0-811692a21e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '110fa889-2ae8-401f-87d3-22b037e0a799', 'volume_name': 'volume-110fa889-2ae8-401f-87d3-22b037e0a799', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de48a662-69b4-45f2-884c-125d9ee57f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de48a662-69b4-45f2-884c-125d9ee57f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af1ebba-c48b-41d1-ae16-5e70cb6de79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:34 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Volume 110fa889-2ae8-401f-87d3-22b037e0a799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-110fa889-2ae8-401f-87d3-22b037e0a799', 'volume_size': 1} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=99cf1fd4-2d9a-429a-97b1-2d9c623920ad,created_at=2026-07-21T17:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1597421364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99cf1fd4-2d9a-429a-97b1-2d9c623920ad,host='devstack@QuobyteHD#QuobyteHD',id=110fa889-2ae8-401f-87d3-22b037e0a799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4e3f9fad604b189674a73c48324b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:34Z,use_quota=True,user_id='0079a6c592a14ad3a34a52245567ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afc82346-68d2-477f-8e07-a7210d99b8b5),volume_type_id=afc82346-68d2-477f-8e07-a7210d99b8b5)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Creating volume 110fa889-2ae8-401f-87d3-22b037e0a799 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:34 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-110fa889-2ae8-401f-87d3-22b037e0a799 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:34 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-110fa889-2ae8-401f-87d3-22b037e0a799 1073741824 Jul 21 19:07:34 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] Created reservations ['b5dc09d1-5b6b-43ef-a263-a1a46c665308', '6c9766f2-9c5a-412f-9586-b328c64055e5', '304a7fa6-50f4-4c18-9ea4-707cb6db6215', 'ffc55ad4-6268-48e1-8932-37b085727d3a'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:34 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] Delete snapshot completed successfully. Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5e93fe71-d8dc-4b4d-bec7-a762d6cb564b tempest-VolumesExtendTest-335062433 None] Lock "cinder-4df477e5-888a-44e5-a907-0e72bbcd3614-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] Acquiring lock "cinder-70a495c4-c106-4ddd-9249-283bb199a2b9-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] Lock "cinder-70a495c4-c106-4ddd-9249-283bb199a2b9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:34 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-110fa889-2ae8-401f-87d3-22b037e0a799 1073741824" returned: 0 in 0.596s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] Acquiring lock "cinder-quobyte-70a495c4-c106-4ddd-9249-283bb199a2b9" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] Lock "cinder-quobyte-70a495c4-c106-4ddd-9249-283bb199a2b9" acquired by "delete_volume" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-110fa889-2ae8-401f-87d3-22b037e0a799 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:35 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c8de6d-8741-47ce-b9d0-3f4ecef96d52]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:35 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-110fa889-2ae8-401f-87d3-22b037e0a799 Jul 21 19:07:35 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:35 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9 Jul 21 19:07:35 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:35 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-110fa889-2ae8-401f-87d3-22b037e0a799" returned: 0 in 0.346s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af1ebba-c48b-41d1-ae16-5e70cb6de79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-110fa889-2ae8-401f-87d3-22b037e0a799', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58288f84-bdac-4082-b8a4-1a5dee6b598a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:35 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Volume volume-110fa889-2ae8-401f-87d3-22b037e0a799 (110fa889-2ae8-401f-87d3-22b037e0a799): created successfully Jul 21 19:07:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58288f84-bdac-4082-b8a4-1a5dee6b598a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Flow 'volume_create_manager' (434b0d0a-1145-4fbd-8d58-bf06beccc097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:35 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-30775fe1-2159-4c35-9dca-04aa99bf6cca tempest-GroupsTest-1633385476 None] Created volume successfully. Jul 21 19:07:35 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9" returned: 0 in 0.529s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:35 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9 Jul 21 19:07:35 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:35 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-70a495c4-c106-4ddd-9249-283bb199a2b9" returned: 0 in 0.305s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] Lock "cinder-quobyte-70a495c4-c106-4ddd-9249-283bb199a2b9" released by "delete_volume" :: held 0.919s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:36 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] Created reservations ['95f090bf-68c3-4064-a77b-624fc30430dd', '24e90c06-d51f-46e2-9bde-6bb1ec119a45', '7a6f69c8-0aa3-464b-9aca-ae8333af111d', 'ac3ee7dc-7804-4b00-8d68-6e94f01b29c1'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:36 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:07:36 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:36 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.382s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:36 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:36 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] Deleted volume successfully. Jul 21 19:07:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b092c40e-d9c6-4057-9d0b-e02b54bd6b82 tempest-VolumesExtendTest-335062433 None] Lock "cinder-70a495c4-c106-4ddd-9249-283bb199a2b9-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Flow 'volume_create_manager' (625ad43c-774b-4adc-976d-ff31f6b2f4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1634b27b-1da0-4066-a922-12bbeb087082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1634b27b-1da0-4066-a922-12bbeb087082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1229133918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99cf1fd4-2d9a-429a-97b1-2d9c623920ad,host='devstack@QuobyteHD#QuobyteHD',id=c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4e3f9fad604b189674a73c48324b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:38Z,use_quota=True,user_id='0079a6c592a14ad3a34a52245567ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afc82346-68d2-477f-8e07-a7210d99b8b5),volume_type_id=afc82346-68d2-477f-8e07-a7210d99b8b5)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f6164b6-6ff3-45bc-b347-c22eb65ccb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f6164b6-6ff3-45bc-b347-c22eb65ccb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6a0463-ea65-474e-9c6f-5ca28c32db52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6a0463-ea65-474e-9c6f-5ca28c32db52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c', 'volume_name': 'volume-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f8b0f8-d5f6-4247-a3df-c1f26a5a6b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f8b0f8-d5f6-4247-a3df-c1f26a5a6b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d27fc96-8e77-41e1-8179-8a48be69f00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:37 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Volume c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c', 'volume_size': 1} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=99cf1fd4-2d9a-429a-97b1-2d9c623920ad,created_at=2026-07-21T17:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1229133918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99cf1fd4-2d9a-429a-97b1-2d9c623920ad,host='devstack@QuobyteHD#QuobyteHD',id=c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4e3f9fad604b189674a73c48324b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:38Z,use_quota=True,user_id='0079a6c592a14ad3a34a52245567ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afc82346-68d2-477f-8e07-a7210d99b8b5),volume_type_id=afc82346-68d2-477f-8e07-a7210d99b8b5)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Creating volume c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:37 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:07:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:37 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c 1073741824 Jul 21 19:07:37 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:38 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c 1073741824" returned: 0 in 0.622s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:38 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c Jul 21 19:07:38 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:38 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c" returned: 0 in 0.391s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d27fc96-8e77-41e1-8179-8a48be69f00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df5b3cd-9e7b-4e0a-baa3-293675625cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:38 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Volume volume-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c (c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c): created successfully Jul 21 19:07:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df5b3cd-9e7b-4e0a-baa3-293675625cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Flow 'volume_create_manager' (625ad43c-774b-4adc-976d-ff31f6b2f4fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:39 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0a9aff36-a55d-47d5-a978-0acc3bc6ee46 tempest-GroupsTest-1633385476 None] Created volume successfully. Jul 21 19:07:40 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-2645cd0f-4604-49c6-827b-8ab03245c7db tempest-GroupsTest-1633385476 None] Update group completed successfully. Jul 21 19:07:40 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4fec6bac-5f42-4cf4-b5bb-420cd20a2fd4 tempest-GroupsV320Test-747765761 None] Group tempest-GroupsV320Test-Group-607654872: creating Jul 21 19:07:40 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-50c6cd7a-0840-4bab-8964-a9b7922253a2 req-8f6b1f41-35e6-407c-a6e0-9e70ae0cd99f tempest-TestMinimumBasicScenario-505434839 None] Terminate volume connection completed successfully. Jul 21 19:07:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-50c6cd7a-0840-4bab-8964-a9b7922253a2 req-8f6b1f41-35e6-407c-a6e0-9e70ae0cd99f tempest-TestMinimumBasicScenario-505434839 None] Deleting attachment e5d605f3-921a-4087-9420-89c1fb9477ac. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:07:40 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4fec6bac-5f42-4cf4-b5bb-420cd20a2fd4 tempest-GroupsV320Test-747765761 None] Group tempest-GroupsV320Test-Group-607654872: created successfully Jul 21 19:07:40 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4fec6bac-5f42-4cf4-b5bb-420cd20a2fd4 tempest-GroupsV320Test-747765761 None] Create group completed successfully. Jul 21 19:07:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] Acquiring lock "cinder-3b9b1a84-efa7-402d-b36a-147713037f26-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] Lock "cinder-3b9b1a84-efa7-402d-b36a-147713037f26-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] Acquiring lock "cinder-quobyte-3b9b1a84-efa7-402d-b36a-147713037f26" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] Lock "cinder-quobyte-3b9b1a84-efa7-402d-b36a-147713037f26" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:41 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[489bcbc6-69e7-46e6-bd4f-d54408abd972]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3b9b1a84-efa7-402d-b36a-147713037f26 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:41 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3b9b1a84-efa7-402d-b36a-147713037f26 Jul 21 19:07:41 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:42 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4607630d-95cd-408a-a9ef-50732a250aa9 tempest-GroupsTest-1633385476 None] Update group completed successfully. Jul 21 19:07:42 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3b9b1a84-efa7-402d-b36a-147713037f26" returned: 0 in 0.561s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3b9b1a84-efa7-402d-b36a-147713037f26 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:42 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3b9b1a84-efa7-402d-b36a-147713037f26 Jul 21 19:07:42 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-38d50bf3-2982-4c88-b141-85e7c45aa08c tempest-GroupsV320Test-747765761 None] Created reservations ['935a62f4-cc77-40a1-8276-775d37dfe1ee'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:42 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3b9b1a84-efa7-402d-b36a-147713037f26" returned: 0 in 0.321s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] Lock "cinder-quobyte-3b9b1a84-efa7-402d-b36a-147713037f26" released by "delete_volume" :: held 0.931s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-38d50bf3-2982-4c88-b141-85e7c45aa08c tempest-GroupsV320Test-747765761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-38d50bf3-2982-4c88-b141-85e7c45aa08c tempest-GroupsV320Test-747765761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-38d50bf3-2982-4c88-b141-85e7c45aa08c tempest-GroupsV320Test-747765761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-38d50bf3-2982-4c88-b141-85e7c45aa08c tempest-GroupsV320Test-747765761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-38d50bf3-2982-4c88-b141-85e7c45aa08c tempest-GroupsV320Test-747765761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38d50bf3-2982-4c88-b141-85e7c45aa08c tempest-GroupsV320Test-747765761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] Created reservations ['83da4168-464a-46d6-874a-47d2f5d6aebb', 'acc23173-994f-47b2-a9b9-3c6f56d8c3f4', '78dd0ce0-c4f3-48b3-bf91-0b586476ba9b', '70775cc7-2640-42c9-b936-5a5eee0a76ac'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:42 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:07:42 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:42 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:07:42 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:43 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38d50bf3-2982-4c88-b141-85e7c45aa08c tempest-GroupsV320Test-747765761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.379s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:43 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-38d50bf3-2982-4c88-b141-85e7c45aa08c tempest-GroupsV320Test-747765761 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:43 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-38d50bf3-2982-4c88-b141-85e7c45aa08c tempest-GroupsV320Test-747765761 None] Delete group completed successfully. Jul 21 19:07:43 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.308s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:43 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:43 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] Deleted volume successfully. Jul 21 19:07:43 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-72591f40-168c-40e3-b6bc-18d2a1694de9 tempest-TestMinimumBasicScenario-505434839 None] Lock "cinder-3b9b1a84-efa7-402d-b36a-147713037f26-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:43 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Acquiring lock "cinder-quobyte-110fa889-2ae8-401f-87d3-22b037e0a799" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:44 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Lock "cinder-quobyte-110fa889-2ae8-401f-87d3-22b037e0a799" acquired by "delete_volume" :: waited 0.026s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:44 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fa0940-8c8b-4397-a08d-aa90500a2a7e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-110fa889-2ae8-401f-87d3-22b037e0a799 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:44 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-110fa889-2ae8-401f-87d3-22b037e0a799 Jul 21 19:07:44 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:44 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-110fa889-2ae8-401f-87d3-22b037e0a799" returned: 0 in 0.842s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-110fa889-2ae8-401f-87d3-22b037e0a799 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:44 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-110fa889-2ae8-401f-87d3-22b037e0a799 Jul 21 19:07:44 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:45 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-110fa889-2ae8-401f-87d3-22b037e0a799" returned: 0 in 0.467s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Lock "cinder-quobyte-110fa889-2ae8-401f-87d3-22b037e0a799" released by "delete_volume" :: held 1.394s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Acquiring lock "cinder-quobyte-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Lock "cinder-quobyte-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c" acquired by "delete_volume" :: waited 0.039s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:45 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f64c3a-a8e8-43c5-98a2-a063d6d3f29f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:45 devstack sudo[97368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c Jul 21 19:07:45 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:46 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c" returned: 0 in 0.534s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:46 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c Jul 21 19:07:46 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:46 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c" returned: 0 in 0.388s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:46 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Lock "cinder-quobyte-c98e897a-9e3c-4f71-ad18-8b1fce8d7f4c" released by "delete_volume" :: held 1.004s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:46 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Created reservations ['741a5d21-1c92-4ac3-b5d6-1efcef3aa643'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:46 devstack cinder-volume[87570]: WARNING cinder.quota [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1591248917 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1591248917, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:07:46 devstack cinder-volume[87570]: WARNING cinder.quota [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1591248917 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1591248917, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:07:46 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Created reservations ['ac7ee7b0-25ac-4356-b9d2-5c94d636e35c', '0e786dc6-0dd5-4245-b27b-ecc7ca4155ae', 'a3f3819a-bacd-4b5a-995f-3dd26f2ec8ec', 'ccc6658d-d6e0-41cd-93c0-21ae27b8b224'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:46 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Created reservations ['db3ea7ff-aa51-4b77-8f8c-032b7e39e1b6', '4be7a392-92fe-44c7-b817-ff560142dcbe', '79c1a802-9229-4864-9719-405f1a7b1b4c', 'c03bfecd-c56d-49e8-a09b-4e99dd53a28b'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:47 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:07:47 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:47 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.445s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:47 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:47 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-21559fcd-e361-49e6-9d97-3ef5247f4862 tempest-GroupsTest-1633385476 None] Delete group completed successfully. Jul 21 19:07:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:07:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:56 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:07:56 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:57 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=120,cinder:INSERT=31,cinder:UPDATE=133,cinder:DELETE=6 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:07:57 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:INSERT=42,cinder:UPDATE=137,cinder:SELECT=123,cinder:DELETE=6 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:07:57 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.536s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:07:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:07:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:08:00 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-cac9052a-6215-471e-9f31-973c0a34bb81 tempest-GroupsV314Test-634457641 None] Group tempest-GroupsV314Test-Group-757579801: creating Jul 21 19:08:01 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-cac9052a-6215-471e-9f31-973c0a34bb81 tempest-GroupsV314Test-634457641 None] Group tempest-GroupsV314Test-Group-757579801: created successfully Jul 21 19:08:01 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-cac9052a-6215-471e-9f31-973c0a34bb81 tempest-GroupsV314Test-634457641 None] Create group completed successfully. Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Flow 'volume_create_manager' (2cea9086-16b0-47be-983d-794db382d83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfffc90-bcec-441d-9304-534bea86bfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfffc90-bcec-441d-9304-534bea86bfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1667262040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94f614f3-667e-43f0-8417-3faa181b1e3b,host='devstack@QuobyteHD#QuobyteHD',id=83f7dcdc-3c2d-4370-8a04-e0fe23c7b261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fcafb0b4af64f0390fce4172a7a5450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:03Z,use_quota=True,user_id='2ea6229cbb7448b7a562d0380a864398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa8eb099-4d48-4439-94b6-b33132927c0a),volume_type_id=fa8eb099-4d48-4439-94b6-b33132927c0a)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3b7862-aa1f-4316-94cd-442e71c434b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3b7862-aa1f-4316-94cd-442e71c434b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6f18ab-d98c-4828-b572-31690211b288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6f18ab-d98c-4828-b572-31690211b288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83f7dcdc-3c2d-4370-8a04-e0fe23c7b261', 'volume_name': 'volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a694f117-5422-486b-9a48-48f6cbe01236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a694f117-5422-486b-9a48-48f6cbe01236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadde150-7154-453c-872d-c7bb59223c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:03 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Volume 83f7dcdc-3c2d-4370-8a04-e0fe23c7b261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261', 'volume_size': 1} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=94f614f3-667e-43f0-8417-3faa181b1e3b,created_at=2026-07-21T17:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1667262040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94f614f3-667e-43f0-8417-3faa181b1e3b,host='devstack@QuobyteHD#QuobyteHD',id=83f7dcdc-3c2d-4370-8a04-e0fe23c7b261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fcafb0b4af64f0390fce4172a7a5450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:03Z,use_quota=True,user_id='2ea6229cbb7448b7a562d0380a864398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa8eb099-4d48-4439-94b6-b33132927c0a),volume_type_id=fa8eb099-4d48-4439-94b6-b33132927c0a)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Creating volume 83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:03 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:03 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 1073741824 Jul 21 19:08:03 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:03 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 1073741824" returned: 0 in 0.679s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:03 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 Jul 21 19:08:03 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:04 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261" returned: 0 in 0.513s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadde150-7154-453c-872d-c7bb59223c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0d1b65-5e28-4a64-a918-84381b0f04ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:04 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Volume volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 (83f7dcdc-3c2d-4370-8a04-e0fe23c7b261): created successfully Jul 21 19:08:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0d1b65-5e28-4a64-a918-84381b0f04ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Flow 'volume_create_manager' (2cea9086-16b0-47be-983d-794db382d83b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:04 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-cea9f430-deed-4739-9040-fcc6b7c3bb56 tempest-GroupsV314Test-634457641 None] Created volume successfully. Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Flow 'volume_create_manager' (4d94c29f-e0ce-4d97-bf57-3853c460225d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73eedd4-c0b0-4a67-8ef4-810648dcb539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73eedd4-c0b0-4a67-8ef4-810648dcb539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1813720974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531b80d0-c2f8-4e3c-8b91-42d4a9dcd296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0ef711ba224be786af1c580c98a498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:06Z,use_quota=True,user_id='63ba7e1a1a0c4442a38070cde87e86c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9566092-be55-4a3c-875b-00e538a0e84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9566092-be55-4a3c-875b-00e538a0e84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0491226-4f30-41bb-9abe-ad9cff6f7c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0491226-4f30-41bb-9abe-ad9cff6f7c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '531b80d0-c2f8-4e3c-8b91-42d4a9dcd296', 'volume_name': 'volume-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b396e3-e560-4946-a52d-d4741b7e8b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b396e3-e560-4946-a52d-d4741b7e8b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60327b5-0575-4b55-902a-546946af7ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:06 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Volume 531b80d0-c2f8-4e3c-8b91-42d4a9dcd296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296', 'volume_size': 1} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1813720974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531b80d0-c2f8-4e3c-8b91-42d4a9dcd296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0ef711ba224be786af1c580c98a498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:06Z,use_quota=True,user_id='63ba7e1a1a0c4442a38070cde87e86c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Creating volume 531b80d0-c2f8-4e3c-8b91-42d4a9dcd296 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:06 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:06 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296 1073741824 Jul 21 19:08:06 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:07 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296 1073741824" returned: 0 in 0.640s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:07 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296 Jul 21 19:08:07 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:07 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296" returned: 0 in 0.295s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.900s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:07 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Cloning volume 83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 to volume 74e01689-c18a-4730-9c58-d3095c52b688 Jul 21 19:08:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60327b5-0575-4b55-902a-546946af7ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb6d062-4441-4028-af5b-e91ccebc5aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:07 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Volume volume-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296 (531b80d0-c2f8-4e3c-8b91-42d4a9dcd296): created successfully Jul 21 19:08:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb6d062-4441-4028-af5b-e91ccebc5aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Flow 'volume_create_manager' (4d94c29f-e0ce-4d97-bf57-3853c460225d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Creating offline snapshot dad0c37e-487e-404d-8494-a3bc7ccc799c of volume 83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:08:07 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e17303-69ba-4712-8bc4-941a454a5489]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:07 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-52e88f99-3595-4b23-aaac-777365753760 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Created volume successfully. Jul 21 19:08:07 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 Jul 21 19:08:07 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:08 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261" returned: 0 in 0.479s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:08 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c 1G Jul 21 19:08:08 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:08 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c 1G" returned: 0 in 0.594s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:08 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c Jul 21 19:08:08 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:09 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c" returned: 0 in 0.417s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:09 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:08:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:09 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c Jul 21 19:08:09 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:09 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c" returned: 0 in 0.356s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:09 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.info Jul 21 19:08:09 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:09 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.info" returned: 0 in 0.339s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:09 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:08:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:09 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.info Jul 21 19:08:09 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Acquiring lock "cinder-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Lock "cinder-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Acquiring lock "cinder-quobyte-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Lock "cinder-quobyte-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296" acquired by "delete_volume" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ba8e8c-d3c6-48f3-bba4-d065d7c388c5]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:10 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.info" returned: 0 in 0.363s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Acquiring lock "cinder-quobyte-74e01689-c18a-4730-9c58-d3095c52b688" by "_copy_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Lock "cinder-quobyte-74e01689-c18a-4730-9c58-d3095c52b688" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] snapshot: dad0c37e-487e-404d-8494-a3bc7ccc799c, volume: 74e01689-c18a-4730-9c58-d3095c52b688, {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:08:10 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296 Jul 21 19:08:10 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[489497e2-71fc-4878-afad-708a124956da]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:10 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c Jul 21 19:08:10 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:10 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296" returned: 0 in 0.517s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:10 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296 Jul 21 19:08:10 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:10 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c" returned: 0 in 0.499s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Creating direct copy from snapshot {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[328177ca-18e7-4513-a904-34576809e49f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:11 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296" returned: 0 in 0.384s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:11 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 Jul 21 19:08:11 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Lock "cinder-quobyte-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296" released by "delete_volume" :: held 0.974s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:11 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Created reservations ['bff248f3-8bce-4614-9a76-44ca4699d060', '33013944-63aa-4ea5-b821-410a9857f361', 'f3853ed8-c51f-4898-a00b-743ea039fc95', '6df05064-99c8-4281-9316-249178ece3a1'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:11 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:08:11 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:11 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261" returned: 0 in 0.559s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:11 devstack cinder-volume[87570]: DEBUG cinder.utils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Path /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-74e01689-c18a-4730-9c58-d3095c52b688 not found in is_blk_device check {{(pid=87570) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:08:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-74e01689-c18a-4730-9c58-d3095c52b688 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:11 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-74e01689-c18a-4730-9c58-d3095c52b688 Jul 21 19:08:11 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:11 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.341s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:11 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:08:11 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Deleted volume successfully. Jul 21 19:08:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ff37fcc-3dde-44ef-b6b6-94d64764d7e6 tempest-VolumeQuotasNegativeTestJSON-1388260103 None] Lock "cinder-531b80d0-c2f8-4e3c-8b91-42d4a9dcd296-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:18 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:18 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Flow 'volume_create_manager' (7cd85eb7-ecc7-4c83-8cd4-88ec37adc40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d4ae91-acd4-49fd-99de-b61d29343916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-74e01689-c18a-4730-9c58-d3095c52b688" returned: 0 in 6.842s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:18 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb57a0f-584f-4029-af08-fecf5360c9f6]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d4ae91-acd4-49fd-99de-b61d29343916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f9e19d-c495-4d01-851c-5c21c5c88910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a2a396bf954d649c2d097a34bd9098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:18Z,use_quota=True,user_id='d15509bb4a9f4e3e8185bbf1df3f24d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785efef8-3e1d-48b6-a830-4d33ef3fd81c),volume_type_id=785efef8-3e1d-48b6-a830-4d33ef3fd81c)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200d3cf1-c817-40c9-99e4-cd3a3a26c98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200d3cf1-c817-40c9-99e4-cd3a3a26c98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4862e30c-410f-4f5b-aaf2-39c181109b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:18 devstack cinder-volume[87570]: DEBUG cinder.image.glance [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Creating Keystone auth plugin from conf {{(pid=87570) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:08:18 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 Jul 21 19:08:18 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Flow 'volume_create_manager' (68214b66-0d41-45cc-891c-f9dd183d6fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87fae5d-acb8-4ba4-b119-b28d13459bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87fae5d-acb8-4ba4-b119-b28d13459bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-26665197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac37b25a-d757-42d9-837c-d192ef2198d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b8e0da7691411aba17b18154fcc8a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:19Z,use_quota=True,user_id='d5b23f9c7ea745a08dc26aa27edb2669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcb2582-6f92-4233-8e5e-806d791c680d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcb2582-6f92-4233-8e5e-806d791c680d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3184186e-159c-4fe1-aa89-f9e77a203831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3184186e-159c-4fe1-aa89-f9e77a203831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac37b25a-d757-42d9-837c-d192ef2198d3', 'volume_name': 'volume-ac37b25a-d757-42d9-837c-d192ef2198d3', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac320ac-31e4-402c-96c9-15edb2582573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac320ac-31e4-402c-96c9-15edb2582573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90acfa76-688c-4db1-a7fe-a5cb3d7df2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:19 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Volume ac37b25a-d757-42d9-837c-d192ef2198d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac37b25a-d757-42d9-837c-d192ef2198d3', 'volume_size': 1} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4862e30c-410f-4f5b-aaf2-39c181109b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '46f9e19d-c495-4d01-851c-5c21c5c88910', 'volume_name': 'volume-46f9e19d-c495-4d01-851c-5c21c5c88910', 'volume_size': 1, 'image_id': '3bd60a8d-b173-4068-8344-df0cd3ebd11e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3bd60a8d-b173-4068-8344-df0cd3ebd11e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd4a4af71264afaadb8d1f14ccc037ebc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '72a2a396bf954d649c2d097a34bd9098', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3478ea2aacc5a68fe17e9341cead75fa44f7b6c8e8a3302f686474430f0847ae0ea3ba6705cd23d0620ace81c5a8fcf5756487327ca5881c977d7f5d2d5f99d', 'id': '3bd60a8d-b173-4068-8344-df0cd3ebd11e', 'created_at': datetime.datetime(2026, 7, 21, 17, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 8, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3bd60a8d-b173-4068-8344-df0cd3ebd11e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4e2e38-1580-48c0-80a1-4056ff45b937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4e2e38-1580-48c0-80a1-4056ff45b937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a803936-dbe3-4fbf-8f91-91f8c43ba116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:19 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Volume 46f9e19d-c495-4d01-851c-5c21c5c88910: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-46f9e19d-c495-4d01-851c-5c21c5c88910', 'volume_size': 1, 'image_id': '3bd60a8d-b173-4068-8344-df0cd3ebd11e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3bd60a8d-b173-4068-8344-df0cd3ebd11e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd4a4af71264afaadb8d1f14ccc037ebc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '72a2a396bf954d649c2d097a34bd9098', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3478ea2aacc5a68fe17e9341cead75fa44f7b6c8e8a3302f686474430f0847ae0ea3ba6705cd23d0620ace81c5a8fcf5756487327ca5881c977d7f5d2d5f99d', 'id': '3bd60a8d-b173-4068-8344-df0cd3ebd11e', 'created_at': datetime.datetime(2026, 7, 21, 17, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 8, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3bd60a8d-b173-4068-8344-df0cd3ebd11e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Trying to clone 46f9e19d-c495-4d01-851c-5c21c5c88910 from image 3bd60a8d-b173-4068-8344-df0cd3ebd11e at location (None, [{'url': 'file:///opt/stack/data/glance/images/3bd60a8d-b173-4068-8344-df0cd3ebd11e', 'metadata': {}}]). {{(pid=87570) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:08:19 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261" returned: 0 in 0.839s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Image conversion details: src /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261, size 1024.00 MB, duration 6.84 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-74e01689-c18a-4730-9c58-d3095c52b688 {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:08:19 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Converted 1024.00 MB image at 149.64 MB/s Jul 21 19:08:19 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-74e01689-c18a-4730-9c58-d3095c52b688 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-74e01689-c18a-4730-9c58-d3095c52b688 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:19 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-74e01689-c18a-4730-9c58-d3095c52b688 Jul 21 19:08:19 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:08:19 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Image download 0.00 MB at 0.00 MB/s Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f43198c-2df7-4476-a2d3-43b53ebc082b]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Flow 'volume_create_manager' (35d784c7-bb78-49c2-9be2-d63b6c62843b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (397c69b9-09b6-4cb1-9077-2810d73f121b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (397c69b9-09b6-4cb1-9077-2810d73f121b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1939935281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e0d532-7903-488d-86c3-13042d32d7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b8e0da7691411aba17b18154fcc8a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:19Z,use_quota=True,user_id='d5b23f9c7ea745a08dc26aa27edb2669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:19 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD Jul 21 19:08:19 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a1e3e9-6dbe-468c-915b-9780bde5ab26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a1e3e9-6dbe-468c-915b-9780bde5ab26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:19 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272729b2-54f9-4734-b0ae-7b5ad6b1fa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272729b2-54f9-4734-b0ae-7b5ad6b1fa9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53e0d532-7903-488d-86c3-13042d32d7c4', 'volume_name': 'volume-53e0d532-7903-488d-86c3-13042d32d7c4', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2dabce-94c7-4072-a980-ec90232a9ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2dabce-94c7-4072-a980-ec90232a9ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0e164f-2290-42e4-90f0-f608ebe10710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:19 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Volume 53e0d532-7903-488d-86c3-13042d32d7c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53e0d532-7903-488d-86c3-13042d32d7c4', 'volume_size': 1} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-74e01689-c18a-4730-9c58-d3095c52b688" returned: 0 in 0.494s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Lock "cinder-quobyte-74e01689-c18a-4730-9c58-d3095c52b688" released by "_copy_volume_from_snapshot" :: held 9.371s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Acquiring lock "cinder-quobyte-dad0c37e-487e-404d-8494-a3bc7ccc799c" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Lock "cinder-quobyte-dad0c37e-487e-404d-8494-a3bc7ccc799c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Deleting offline snapshot dad0c37e-487e-404d-8494-a3bc7ccc799c of volume 83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] snapshot_file for this snap is: volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b5ebd9-71c6-42a1-9628-ce13f2cab30e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:19 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c Jul 21 19:08:19 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:19 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:20 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD Jul 21 19:08:20 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:20 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c" returned: 0 in 0.544s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:20 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5c6a6a-0639-4495-b882-5b615311a20e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:20 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD" returned: 1 in 0.483s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:08:20 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Temporary image 3bd60a8d-b173-4068-8344-df0cd3ebd11e is fetched for user d15509bb4a9f4e3e8185bbf1df3f24d5. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:08:20 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 Jul 21 19:08:20 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:20 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc59bb9-9155-43fe-9aaf-802e83bf2f89]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:20 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD Jul 21 19:08:20 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:20 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261" returned: 0 in 0.491s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:20 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c Jul 21 19:08:20 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:20 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:21 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD Jul 21 19:08:21 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:21 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD" returned: 1 in 0.422s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:21 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c" returned: 0 in 0.506s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:21 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c Jul 21 19:08:21 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:21 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261.dad0c37e-487e-404d-8494-a3bc7ccc799c" returned: 0 in 0.382s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Lock "cinder-quobyte-dad0c37e-487e-404d-8494-a3bc7ccc799c" released by "_delete_snapshot" :: held 2.048s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.276s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.664s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-26665197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac37b25a-d757-42d9-837c-d192ef2198d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b8e0da7691411aba17b18154fcc8a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:19Z,use_quota=True,user_id='d5b23f9c7ea745a08dc26aa27edb2669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Creating volume ac37b25a-d757-42d9-837c-d192ef2198d3 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:21 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:08:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac37b25a-d757-42d9-837c-d192ef2198d3 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:21 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac37b25a-d757-42d9-837c-d192ef2198d3 1073741824 Jul 21 19:08:21 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:21 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-75971a9b-f109-4e98-8526-a6da1add8347 tempest-GroupsV314Test-634457641 None] Create group from source-group-94f614f3-667e-43f0-8417-3faa181b1e3b completed successfully. Jul 21 19:08:22 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac37b25a-d757-42d9-837c-d192ef2198d3 1073741824" returned: 0 in 0.651s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac37b25a-d757-42d9-837c-d192ef2198d3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:22 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac37b25a-d757-42d9-837c-d192ef2198d3 Jul 21 19:08:22 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:22 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac37b25a-d757-42d9-837c-d192ef2198d3" returned: 0 in 0.294s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.119s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1939935281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e0d532-7903-488d-86c3-13042d32d7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b8e0da7691411aba17b18154fcc8a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:19Z,use_quota=True,user_id='d5b23f9c7ea745a08dc26aa27edb2669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Creating volume 53e0d532-7903-488d-86c3-13042d32d7c4 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:22 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-53e0d532-7903-488d-86c3-13042d32d7c4 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90acfa76-688c-4db1-a7fe-a5cb3d7df2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac37b25a-d757-42d9-837c-d192ef2198d3', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c29a69-e79e-4e84-bffd-849a184b8888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:22 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-53e0d532-7903-488d-86c3-13042d32d7c4 1073741824 Jul 21 19:08:22 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:22 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Volume volume-ac37b25a-d757-42d9-837c-d192ef2198d3 (ac37b25a-d757-42d9-837c-d192ef2198d3): created successfully Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c29a69-e79e-4e84-bffd-849a184b8888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Flow 'volume_create_manager' (68214b66-0d41-45cc-891c-f9dd183d6fb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:22 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-3fed8c26-2d7b-4daf-9e05-37fcae1423af tempest-TestServerVolumeAttachmentScenario-1245275541 None] Created volume successfully. Jul 21 19:08:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] Acquiring lock "cinder-quobyte-74e01689-c18a-4730-9c58-d3095c52b688" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] Lock "cinder-quobyte-74e01689-c18a-4730-9c58-d3095c52b688" acquired by "delete_volume" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:23 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13a64df-c02d-4a01-802d-cd571e745fa2]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-74e01689-c18a-4730-9c58-d3095c52b688 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:23 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-53e0d532-7903-488d-86c3-13042d32d7c4 1073741824" returned: 0 in 0.793s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-53e0d532-7903-488d-86c3-13042d32d7c4 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:23 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-53e0d532-7903-488d-86c3-13042d32d7c4 Jul 21 19:08:23 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:23 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-74e01689-c18a-4730-9c58-d3095c52b688 Jul 21 19:08:23 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:24 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-53e0d532-7903-488d-86c3-13042d32d7c4" returned: 0 in 0.355s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.699s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f9e19d-c495-4d01-851c-5c21c5c88910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a2a396bf954d649c2d097a34bd9098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:18Z,use_quota=True,user_id='d15509bb4a9f4e3e8185bbf1df3f24d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785efef8-3e1d-48b6-a830-4d33ef3fd81c),volume_type_id=785efef8-3e1d-48b6-a830-4d33ef3fd81c)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Creating volume 46f9e19d-c495-4d01-851c-5c21c5c88910 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:24 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0e164f-2290-42e4-90f0-f608ebe10710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53e0d532-7903-488d-86c3-13042d32d7c4', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a988c2-846b-4c62-a144-db46c9bf784a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:24 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910 1073741824 Jul 21 19:08:24 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:24 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Volume volume-53e0d532-7903-488d-86c3-13042d32d7c4 (53e0d532-7903-488d-86c3-13042d32d7c4): created successfully Jul 21 19:08:24 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a988c2-846b-4c62-a144-db46c9bf784a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Flow 'volume_create_manager' (35d784c7-bb78-49c2-9be2-d63b6c62843b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-74e01689-c18a-4730-9c58-d3095c52b688" returned: 0 in 0.570s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-74e01689-c18a-4730-9c58-d3095c52b688 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:24 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-5eeec21e-2247-4e93-aaec-1b8d67b9667e tempest-TestServerVolumeAttachmentScenario-1245275541 None] Created volume successfully. Jul 21 19:08:24 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-74e01689-c18a-4730-9c58-d3095c52b688 Jul 21 19:08:24 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:24 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-74e01689-c18a-4730-9c58-d3095c52b688" returned: 0 in 0.344s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] Lock "cinder-quobyte-74e01689-c18a-4730-9c58-d3095c52b688" released by "delete_volume" :: held 0.986s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] Created reservations ['949029a8-877d-4711-9823-c1aeb9c38f5a'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:24 devstack cinder-volume[87570]: WARNING cinder.quota [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-377198382 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-377198382, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:08:24 devstack cinder-volume[87570]: WARNING cinder.quota [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-377198382 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-377198382, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] Created reservations ['0ba6b065-14d2-489d-b1bc-e62019ab91e9', 'ca71a641-c29c-4892-b308-cf88934daedd', '5a09a1f2-7d35-47d5-b676-39a203763282', '0aed11df-1d30-4288-99cc-bd511885f7c3'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:24 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910 1073741824" returned: 0 in 0.684s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:24 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910 Jul 21 19:08:24 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:25 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:08:25 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:25 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910" returned: 0 in 0.389s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:25 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Attempting download of 3bd60a8d-b173-4068-8344-df0cd3ebd11e ((None, [{'url': 'file:///opt/stack/data/glance/images/3bd60a8d-b173-4068-8344-df0cd3ebd11e', 'metadata': {}}])) to volume 46f9e19d-c495-4d01-851c-5c21c5c88910. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:08:25 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d24ed49-213f-4a32-bf89-6fc5f5ed97cf]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3bd60a8d-b173-4068-8344-df0cd3ebd11e_q61rps8c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:25 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.509s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:25 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:08:25 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f0acada8-a46e-4bdb-8dbf-46b40d0c9c85 tempest-GroupsV314Test-634457641 None] Delete group completed successfully. Jul 21 19:08:25 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3bd60a8d-b173-4068-8344-df0cd3ebd11e_q61rps8c Jul 21 19:08:25 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:26 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3bd60a8d-b173-4068-8344-df0cd3ebd11e_q61rps8c" returned: 0 in 0.591s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3bd60a8d-b173-4068-8344-df0cd3ebd11e_q61rps8c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:26 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3bd60a8d-b173-4068-8344-df0cd3ebd11e_q61rps8c Jul 21 19:08:26 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] Acquiring lock "cinder-quobyte-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:26 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] Lock "cinder-quobyte-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261" acquired by "delete_volume" :: waited 0.024s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3bd60a8d-b173-4068-8344-df0cd3ebd11e_q61rps8c" returned: 1 in 0.614s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3bd60a8d-b173-4068-8344-df0cd3ebd11e_q61rps8c' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:08:26 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd822c50-205f-4688-8085-9599c9684b9a]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:26 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe26d985-3c61-46e1-8a83-54fb8bac7c7b]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:26 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 Jul 21 19:08:26 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:26 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD Jul 21 19:08:26 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:27 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261" returned: 0 in 0.557s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:27 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261 Jul 21 19:08:27 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:27 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD" returned: 0 in 0.636s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:27 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD Jul 21 19:08:27 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:27 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261" returned: 0 in 0.365s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] Lock "cinder-quobyte-83f7dcdc-3c2d-4370-8a04-e0fe23c7b261" released by "delete_volume" :: held 1.020s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:27 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD" returned: 1 in 0.439s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:08:27 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] 3bd60a8d-b173-4068-8344-df0cd3ebd11e was raw, converting to qcow2 {{(pid=87570) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:08:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:27 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] Created reservations ['4146b167-16ae-461f-aa11-8a1703f38e91'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:27 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910 Jul 21 19:08:27 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:27 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] Created reservations ['5c85c5f9-391f-4dd4-bcec-21804ca31b6c', '60cce45a-0c56-4c62-97f4-182a91047cb2', '827e1597-e6e9-4ff1-bd50-a784bd716055', 'e38f196d-148e-4cd7-b77d-1a54139035e6'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:28 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:08:28 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:28 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910" returned: 0 in 0.837s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:28 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3bd60a8d-b173-4068-8344-df0cd3ebd11e_l_f_wxuhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910 {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:08:28 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 19:08:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:28 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910 1G Jul 21 19:08:28 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:28 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.648s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:28 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:08:28 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-211201ef-3fed-4a3f-a0ba-63745361a8d9 tempest-GroupsV314Test-634457641 None] Delete group completed successfully. Jul 21 19:08:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910 1G" returned: 0 in 0.506s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:29 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Downloaded image 3bd60a8d-b173-4068-8344-df0cd3ebd11e ((None, [{'url': 'file:///opt/stack/data/glance/images/3bd60a8d-b173-4068-8344-df0cd3ebd11e', 'metadata': {}}])) to volume 46f9e19d-c495-4d01-851c-5c21c5c88910 successfully. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:08:29 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Temporary image 3bd60a8d-b173-4068-8344-df0cd3ebd11e for user d15509bb4a9f4e3e8185bbf1df3f24d5 is deleted. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:08:29 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Marking volume 46f9e19d-c495-4d01-851c-5c21c5c88910 as bootable. {{(pid=87570) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:08:29 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:29 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Copying metadata from image 3bd60a8d-b173-4068-8344-df0cd3ebd11e to 46f9e19d-c495-4d01-851c-5c21c5c88910. {{(pid=87570) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:08:29 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Creating volume glance metadata for volume 46f9e19d-c495-4d01-851c-5c21c5c88910 backed by image 3bd60a8d-b173-4068-8344-df0cd3ebd11e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3bd60a8d-b173-4068-8344-df0cd3ebd11e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd4a4af71264afaadb8d1f14ccc037ebc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87570) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:08:29 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a803936-dbe3-4fbf-8f91-91f8c43ba116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46f9e19d-c495-4d01-851c-5c21c5c88910', 'volume_size': 1, 'image_id': '3bd60a8d-b173-4068-8344-df0cd3ebd11e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3bd60a8d-b173-4068-8344-df0cd3ebd11e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd4a4af71264afaadb8d1f14ccc037ebc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '72a2a396bf954d649c2d097a34bd9098', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3478ea2aacc5a68fe17e9341cead75fa44f7b6c8e8a3302f686474430f0847ae0ea3ba6705cd23d0620ace81c5a8fcf5756487327ca5881c977d7f5d2d5f99d', 'id': '3bd60a8d-b173-4068-8344-df0cd3ebd11e', 'created_at': datetime.datetime(2026, 7, 21, 17, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 8, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3bd60a8d-b173-4068-8344-df0cd3ebd11e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:29 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94da94a-8a92-4bce-b419-70e64baec28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:29 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Volume volume-46f9e19d-c495-4d01-851c-5c21c5c88910 (46f9e19d-c495-4d01-851c-5c21c5c88910): created successfully Jul 21 19:08:29 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94da94a-8a92-4bce-b419-70e64baec28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:29 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Flow 'volume_create_manager' (7cd85eb7-ecc7-4c83-8cd4-88ec37adc40a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:29 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-fcc5dffb-9d7d-4ce8-9851-8cceb3c27838 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Created volume successfully. Jul 21 19:08:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Acquiring lock "cinder-46f9e19d-c495-4d01-851c-5c21c5c88910-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Lock "cinder-46f9e19d-c495-4d01-851c-5c21c5c88910-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Acquiring lock "cinder-quobyte-46f9e19d-c495-4d01-851c-5c21c5c88910" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Lock "cinder-quobyte-46f9e19d-c495-4d01-851c-5c21c5c88910" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:31 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cca2312-9136-4325-a335-0241c6d6f5ff]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:31 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910 Jul 21 19:08:31 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:31 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910" returned: 0 in 0.648s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:31 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910 Jul 21 19:08:31 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:32 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-46f9e19d-c495-4d01-851c-5c21c5c88910" returned: 0 in 0.448s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Lock "cinder-quobyte-46f9e19d-c495-4d01-851c-5c21c5c88910" released by "delete_volume" :: held 1.183s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:32 devstack cinder-volume[87570]: WARNING cinder.quota [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:08:32 devstack cinder-volume[87570]: WARNING cinder.quota [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:08:32 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Created reservations ['746e7ff2-ecf7-465f-b37b-54fd487c6371', '52d8e109-5693-49c5-aa23-c9114282d737', '5b2c8606-54a9-47fb-9c01-0271d34ad521', 'e4032bcd-c6c3-438c-baf7-0063b6c2471e'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:32 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:32 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:32 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:08:32 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:32 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.456s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:32 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:08:32 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Deleted volume successfully. Jul 21 19:08:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dc9457a6-8c37-4105-8d0a-4313a83a2574 tempest-VolumeAndVolumeTypeFromImageTest-2055776401 None] Lock "cinder-46f9e19d-c495-4d01-851c-5c21c5c88910-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:38 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Flow 'volume_create_manager' (92f4faeb-d0fb-4dbc-897a-b80075a8afd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a03023f-b892-46c0-9b30-f2bb8a67da2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a03023f-b892-46c0-9b30-f2bb8a67da2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1798359821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0a0a04-ba62-46ab-b658-40a4a99fbf76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5ab0cf49c841149b79d3e141a6dbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:39Z,use_quota=True,user_id='e869733addf74b1ebdd28ebc2d214266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ea70f8-d216-427b-a0eb-f1db7fc4a163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ea70f8-d216-427b-a0eb-f1db7fc4a163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8805fe2e-269a-4e46-b30a-3d61597c1a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8805fe2e-269a-4e46-b30a-3d61597c1a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f0a0a04-ba62-46ab-b658-40a4a99fbf76', 'volume_name': 'volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c936323e-ada8-48ec-8387-3050ff726f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c936323e-ada8-48ec-8387-3050ff726f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bd4a4d-64b2-4843-b4af-893ed00fcd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:39 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Volume 8f0a0a04-ba62-46ab-b658-40a4a99fbf76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76', 'volume_size': 1} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1798359821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0a0a04-ba62-46ab-b658-40a4a99fbf76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5ab0cf49c841149b79d3e141a6dbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:39Z,use_quota=True,user_id='e869733addf74b1ebdd28ebc2d214266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Creating volume 8f0a0a04-ba62-46ab-b658-40a4a99fbf76 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:39 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:39 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76 1073741824 Jul 21 19:08:39 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:39 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76 1073741824" returned: 0 in 0.806s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:40 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76 Jul 21 19:08:40 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:40 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" returned: 0 in 0.421s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bd4a4d-64b2-4843-b4af-893ed00fcd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32519bb7-e0d1-445d-b36b-97c00e6961c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:40 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Volume volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76 (8f0a0a04-ba62-46ab-b658-40a4a99fbf76): created successfully Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32519bb7-e0d1-445d-b36b-97c00e6961c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Flow 'volume_create_manager' (92f4faeb-d0fb-4dbc-897a-b80075a8afd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:40 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8ad25b78-380a-4a6a-8c8a-e005968f3dee tempest-SnapshotsActionsTest-444139151 None] Created volume successfully. Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Flow 'volume_create_manager' (a8f6bd99-87a4-4698-995c-4924e902d5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfb2143-61a0-4d5e-b377-a8a31c267ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfb2143-61a0-4d5e-b377-a8a31c267ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc18600-d1c4-4f73-b440-e5c45bddb8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c89ed56a61b4a7d9c970b1c31185043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:41Z,use_quota=True,user_id='f730a0608209457c8dce9ea7d5516cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7043757f-2a87-412e-bd8e-306f1c3cf9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7043757f-2a87-412e-bd8e-306f1c3cf9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (febc0911-31d1-4d38-a30c-7f6b686e8f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (febc0911-31d1-4d38-a30c-7f6b686e8f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc18600-d1c4-4f73-b440-e5c45bddb8ce', 'volume_name': 'volume-4cc18600-d1c4-4f73-b440-e5c45bddb8ce', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c31960c-38c6-4981-bc1a-cbcce66e2b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c31960c-38c6-4981-bc1a-cbcce66e2b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5341273d-bda3-4cbc-8f99-926a1f669a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:40 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Volume 4cc18600-d1c4-4f73-b440-e5c45bddb8ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc18600-d1c4-4f73-b440-e5c45bddb8ce', 'volume_size': 1} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc18600-d1c4-4f73-b440-e5c45bddb8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c89ed56a61b4a7d9c970b1c31185043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:41Z,use_quota=True,user_id='f730a0608209457c8dce9ea7d5516cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Creating volume 4cc18600-d1c4-4f73-b440-e5c45bddb8ce {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:40 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:08:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4cc18600-d1c4-4f73-b440-e5c45bddb8ce 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:40 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4cc18600-d1c4-4f73-b440-e5c45bddb8ce 1073741824 Jul 21 19:08:40 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:41 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4cc18600-d1c4-4f73-b440-e5c45bddb8ce 1073741824" returned: 0 in 0.582s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4cc18600-d1c4-4f73-b440-e5c45bddb8ce {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:41 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4cc18600-d1c4-4f73-b440-e5c45bddb8ce Jul 21 19:08:41 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:41 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4cc18600-d1c4-4f73-b440-e5c45bddb8ce" returned: 0 in 0.289s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.252s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5341273d-bda3-4cbc-8f99-926a1f669a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc18600-d1c4-4f73-b440-e5c45bddb8ce', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12bb01dd-5d3a-4959-bd05-ce822a90c093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] Creating offline snapshot 542a60a4-8259-4e9a-b204-9d986519026a of volume 8f0a0a04-ba62-46ab-b658-40a4a99fbf76 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:08:41 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Volume volume-4cc18600-d1c4-4f73-b440-e5c45bddb8ce (4cc18600-d1c4-4f73-b440-e5c45bddb8ce): created successfully Jul 21 19:08:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12bb01dd-5d3a-4959-bd05-ce822a90c093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Flow 'volume_create_manager' (a8f6bd99-87a4-4698-995c-4924e902d5c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:41 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a53b330-7974-4c04-a0a2-0343a8e1e358]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:41 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-7d753b44-1828-45ed-abb2-0aa4ba3fd07e tempest-CinderUnicodeTest-887064997 None] Created volume successfully. Jul 21 19:08:41 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76 Jul 21 19:08:41 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:42 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" returned: 0 in 0.431s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:42 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a 1G Jul 21 19:08:42 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:42 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a 1G" returned: 0 in 0.527s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:42 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a Jul 21 19:08:42 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:43 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a" returned: 0 in 0.361s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:43 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a is being set with open permissions: ugo+rw Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:43 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a Jul 21 19:08:43 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:43 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Flow 'volume_create_manager' (90d93fb9-69c7-4451-b193-1a1e502e8fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0925f0b8-329f-4106-ac02-3d71bedfb96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a" returned: 0 in 0.473s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0925f0b8-329f-4106-ac02-3d71bedfb96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-171399869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcbffd1f-8840-483a-ba01-9cc95ecebac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c89ed56a61b4a7d9c970b1c31185043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:43Z,use_quota=True,user_id='f730a0608209457c8dce9ea7d5516cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c667966d-7dde-460a-9762-be55bf79da4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c667966d-7dde-460a-9762-be55bf79da4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58085dc7-f047-4b9b-939f-725b34938665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58085dc7-f047-4b9b-939f-725b34938665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcbffd1f-8840-483a-ba01-9cc95ecebac5', 'volume_name': 'volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71dc6b2-3d1d-4c85-bcd8-5abb3a6d3c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71dc6b2-3d1d-4c85-bcd8-5abb3a6d3c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0191cc0-4482-4f01-9c19-f31e1b4069ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:43 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Volume fcbffd1f-8840-483a-ba01-9cc95ecebac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5', 'volume_size': 1} Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:43 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.info Jul 21 19:08:43 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:43 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.info" returned: 0 in 0.305s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:43 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.info is being set with open permissions: ugo+rw Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:43 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.info Jul 21 19:08:43 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:43 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Flow 'volume_create_manager' (d1d9408b-2078-48ef-80ba-a25781b0783e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a96e3b-af63-4f31-bef7-7e73c7d33f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a96e3b-af63-4f31-bef7-7e73c7d33f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-819143705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba9f0e5-140e-4335-b028-9e6e76d5c382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05d5712c72846bc81f5c0d84b041b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:44Z,use_quota=True,user_id='0290e1cb3dc14f6e8acd6dc1f6a34872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02f6c74-8370-4d4f-8f83-99642207ab14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02f6c74-8370-4d4f-8f83-99642207ab14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3d210c-8532-4354-9a22-e068876ad1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3d210c-8532-4354-9a22-e068876ad1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba9f0e5-140e-4335-b028-9e6e76d5c382', 'volume_name': 'volume-bba9f0e5-140e-4335-b028-9e6e76d5c382', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48baa625-4e31-4254-9224-acb7c7956e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48baa625-4e31-4254-9224-acb7c7956e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2013a2-9712-4b7f-9064-168db6312abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:44 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Volume bba9f0e5-140e-4335-b028-9e6e76d5c382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba9f0e5-140e-4335-b028-9e6e76d5c382', 'volume_size': 1} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:44 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.info" returned: 0 in 0.271s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.554s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.624s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-171399869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcbffd1f-8840-483a-ba01-9cc95ecebac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c89ed56a61b4a7d9c970b1c31185043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:43Z,use_quota=True,user_id='f730a0608209457c8dce9ea7d5516cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Creating volume fcbffd1f-8840-483a-ba01-9cc95ecebac5 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:44 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:44 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5 1073741824 Jul 21 19:08:44 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:44 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-e8c5c849-7b1a-4ebc-866b-c6745cf144a2 tempest-SnapshotsActionsTest-444139151 None] Create snapshot completed successfully Jul 21 19:08:44 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5 1073741824" returned: 0 in 0.465s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:44 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5 Jul 21 19:08:44 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:44 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5" returned: 0 in 0.262s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.934s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-819143705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba9f0e5-140e-4335-b028-9e6e76d5c382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05d5712c72846bc81f5c0d84b041b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:44Z,use_quota=True,user_id='0290e1cb3dc14f6e8acd6dc1f6a34872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Creating volume bba9f0e5-140e-4335-b028-9e6e76d5c382 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:45 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bba9f0e5-140e-4335-b028-9e6e76d5c382 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0191cc0-4482-4f01-9c19-f31e1b4069ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe75e7f-4021-483f-9e57-7298b7a4a713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:45 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bba9f0e5-140e-4335-b028-9e6e76d5c382 1073741824 Jul 21 19:08:45 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:45 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Volume volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5 (fcbffd1f-8840-483a-ba01-9cc95ecebac5): created successfully Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe75e7f-4021-483f-9e57-7298b7a4a713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Flow 'volume_create_manager' (90d93fb9-69c7-4451-b193-1a1e502e8fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:45 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-86351579-9bdc-488d-a31d-078107a5d199 tempest-CinderUnicodeTest-887064997 None] Created volume successfully. Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e1dba7ef-fb2f-4cb1-9cee-962102881f6e tempest-SnapshotsActionsTest-444139151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:45 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bba9f0e5-140e-4335-b028-9e6e76d5c382 1073741824" returned: 0 in 0.498s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bba9f0e5-140e-4335-b028-9e6e76d5c382 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:45 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bba9f0e5-140e-4335-b028-9e6e76d5c382 Jul 21 19:08:45 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:45 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bba9f0e5-140e-4335-b028-9e6e76d5c382" returned: 0 in 0.275s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e1dba7ef-fb2f-4cb1-9cee-962102881f6e tempest-SnapshotsActionsTest-444139151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.691s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2013a2-9712-4b7f-9064-168db6312abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba9f0e5-140e-4335-b028-9e6e76d5c382', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ba4027-f614-4b6a-9e87-5f0c6ba0fa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-e1dba7ef-fb2f-4cb1-9cee-962102881f6e tempest-SnapshotsActionsTest-444139151 None] Creating offline snapshot cacff0bb-6b03-4df6-b664-ce7bc5d097b2 of volume 8f0a0a04-ba62-46ab-b658-40a4a99fbf76 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:08:45 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Volume volume-bba9f0e5-140e-4335-b028-9e6e76d5c382 (bba9f0e5-140e-4335-b028-9e6e76d5c382): created successfully Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ba4027-f614-4b6a-9e87-5f0c6ba0fa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Flow 'volume_create_manager' (d1d9408b-2078-48ef-80ba-a25781b0783e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfd638f-a7e3-4d18-a9ab-ec73cbae9af8]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e1dba7ef-fb2f-4cb1-9cee-962102881f6e tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:45 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f1404945-e45c-49f6-bfee-4d720d0d1517 tempest-VolumesTransfersTest-3271704 None] Created volume successfully. Jul 21 19:08:46 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a Jul 21 19:08:46 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:46 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e1dba7ef-fb2f-4cb1-9cee-962102881f6e tempest-SnapshotsActionsTest-444139151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a" returned: 0 in 0.405s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-e1dba7ef-fb2f-4cb1-9cee-962102881f6e tempest-SnapshotsActionsTest-444139151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e1dba7ef-fb2f-4cb1-9cee-962102881f6e tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:46 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2 1G Jul 21 19:08:46 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:46 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-ef916bca-d129-44c7-9db0-48df5367987d tempest-VolumesTransfersTest-1490333426 None] Transfer volume completed successfully. Jul 21 19:08:46 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e1dba7ef-fb2f-4cb1-9cee-962102881f6e tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2 1G" returned: 0 in 0.517s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e1dba7ef-fb2f-4cb1-9cee-962102881f6e tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:46 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2 Jul 21 19:08:46 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:47 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e1dba7ef-fb2f-4cb1-9cee-962102881f6e tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2" returned: 0 in 0.302s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:47 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-e1dba7ef-fb2f-4cb1-9cee-962102881f6e tempest-SnapshotsActionsTest-444139151 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2 is being set with open permissions: ugo+rw Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e1dba7ef-fb2f-4cb1-9cee-962102881f6e tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:47 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2 Jul 21 19:08:47 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] Acquiring lock "cinder-bba9f0e5-140e-4335-b028-9e6e76d5c382-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] Lock "cinder-bba9f0e5-140e-4335-b028-9e6e76d5c382-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] Acquiring lock "cinder-quobyte-bba9f0e5-140e-4335-b028-9e6e76d5c382" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] Lock "cinder-quobyte-bba9f0e5-140e-4335-b028-9e6e76d5c382" acquired by "delete_volume" :: waited 0.019s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8f1f79-3e38-4beb-a4bc-5e9863178207]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bba9f0e5-140e-4335-b028-9e6e76d5c382 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:47 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e1dba7ef-fb2f-4cb1-9cee-962102881f6e tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2" returned: 0 in 0.287s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e1dba7ef-fb2f-4cb1-9cee-962102881f6e tempest-SnapshotsActionsTest-444139151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.649s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.667s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] Creating offline snapshot 4851b4fc-0189-4c33-8171-60a8993bb208 of volume fcbffd1f-8840-483a-ba01-9cc95ecebac5 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:08:47 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bba9f0e5-140e-4335-b028-9e6e76d5c382 Jul 21 19:08:47 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:47 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-e1dba7ef-fb2f-4cb1-9cee-962102881f6e tempest-SnapshotsActionsTest-444139151 None] Create snapshot completed successfully Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61f0d6f-757c-4c35-bcc0-1d4bbf4017a1]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:47 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5 Jul 21 19:08:47 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:47 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bba9f0e5-140e-4335-b028-9e6e76d5c382" returned: 0 in 0.422s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bba9f0e5-140e-4335-b028-9e6e76d5c382 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:47 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bba9f0e5-140e-4335-b028-9e6e76d5c382 Jul 21 19:08:47 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:47 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5" returned: 0 in 0.386s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:47 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208 1G Jul 21 19:08:47 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:48 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bba9f0e5-140e-4335-b028-9e6e76d5c382" returned: 0 in 0.282s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] Lock "cinder-quobyte-bba9f0e5-140e-4335-b028-9e6e76d5c382" released by "delete_volume" :: held 0.763s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] Created reservations ['9543275d-5c80-46fa-a452-c2985d2f5d70', '2688004d-b662-48fc-bd9b-f8d0acbbd46e', '78198871-8c1a-4114-a536-d1bd37f736da', 'e37674f2-4cf8-47ae-ad5f-62349a9e5524'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:48 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:08:48 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Acquiring lock "cinder-cacff0bb-6b03-4df6-b664-ce7bc5d097b2-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:48 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208 1G" returned: 0 in 0.616s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-cacff0bb-6b03-4df6-b664-ce7bc5d097b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Acquiring lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:48 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208 Jul 21 19:08:48 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Acquiring lock "cinder-quobyte-cacff0bb-6b03-4df6-b664-ce7bc5d097b2" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:48 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-quobyte-cacff0bb-6b03-4df6-b664-ce7bc5d097b2" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Deleting offline snapshot cacff0bb-6b03-4df6-b664-ce7bc5d097b2 of volume 8f0a0a04-ba62-46ab-b658-40a4a99fbf76 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] snapshot_file for this snap is: volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.410s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:08:48 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] Deleted volume successfully. Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a56cca1-ebf9-421c-bc1b-7e27988d0e34]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8cb4dfc-67e2-4fb6-98a3-335e0eb0c323 tempest-VolumesTransfersTest-816362296 None] Lock "cinder-bba9f0e5-140e-4335-b028-9e6e76d5c382-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:48 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2 Jul 21 19:08:48 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:49 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208" returned: 0 in 0.469s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:49 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208 is being set with open permissions: ugo+rw Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:49 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208 Jul 21 19:08:49 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:49 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2" returned: 0 in 0.525s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e29ef4-a36b-4364-9a0f-c8f9a8986d48]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Flow 'volume_create_manager' (093f5651-551a-482d-a9f8-9f7aad94e9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e58829-975f-4cbe-bc65-a1055aa28d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e58829-975f-4cbe-bc65-a1055aa28d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1589999622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb3da30-3bbe-4f85-a284-953cab0a9324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05d5712c72846bc81f5c0d84b041b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:49Z,use_quota=True,user_id='0290e1cb3dc14f6e8acd6dc1f6a34872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267f5b5a-07f6-400b-99b8-909f2be3f44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:49 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267f5b5a-07f6-400b-99b8-909f2be3f44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1f07af-272e-4ed7-b5d5-7ace76ea1fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1f07af-272e-4ed7-b5d5-7ace76ea1fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffb3da30-3bbe-4f85-a284-953cab0a9324', 'volume_name': 'volume-ffb3da30-3bbe-4f85-a284-953cab0a9324', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8b2641-03d8-4cc7-88cc-b6f95127570e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8b2641-03d8-4cc7-88cc-b6f95127570e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b365fd01-9095-4442-9eb4-daa2d2adde92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:49 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Volume ffb3da30-3bbe-4f85-a284-953cab0a9324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffb3da30-3bbe-4f85-a284-953cab0a9324', 'volume_size': 1} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208" returned: 0 in 0.393s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:49 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a Jul 21 19:08:49 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:49 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.info Jul 21 19:08:49 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:49 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:49 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a" returned: 0 in 0.465s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.info" returned: 0 in 0.333s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:49 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.info is being set with open permissions: ugo+rw Jul 21 19:08:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:49 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2 Jul 21 19:08:49 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:49 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.info Jul 21 19:08:49 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:50 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.info" returned: 0 in 0.293s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.615s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.683s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1589999622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb3da30-3bbe-4f85-a284-953cab0a9324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05d5712c72846bc81f5c0d84b041b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:49Z,use_quota=True,user_id='0290e1cb3dc14f6e8acd6dc1f6a34872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Creating volume ffb3da30-3bbe-4f85-a284-953cab0a9324 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:50 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ffb3da30-3bbe-4f85-a284-953cab0a9324 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:50 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ffb3da30-3bbe-4f85-a284-953cab0a9324 1073741824 Jul 21 19:08:50 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:50 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-838ce1e2-9975-45ce-bed3-58aaf1477775 tempest-CinderUnicodeTest-887064997 None] Create snapshot completed successfully Jul 21 19:08:50 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2" returned: 0 in 0.480s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:50 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2 Jul 21 19:08:50 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:50 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.cacff0bb-6b03-4df6-b664-ce7bc5d097b2" returned: 0 in 0.287s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-quobyte-cacff0bb-6b03-4df6-b664-ce7bc5d097b2" released by "_delete_snapshot" :: held 1.930s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" released by "delete_snapshot" :: held 1.967s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Created reservations ['2bee23b1-94af-49bf-af9b-b2a69638f674', 'c116dbb4-e06e-43ea-b97f-c1a90651421c', '69d95781-632e-4d86-85ba-5fddd6957215', 'abe6efce-3965-4448-ad1d-e5a6bda89f6d'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:50 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ffb3da30-3bbe-4f85-a284-953cab0a9324 1073741824" returned: 0 in 0.595s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ffb3da30-3bbe-4f85-a284-953cab0a9324 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:50 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Delete snapshot completed successfully. Jul 21 19:08:50 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cbc1b467-f09d-44e8-b52a-6c07f2fe8fa4 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-cacff0bb-6b03-4df6-b664-ce7bc5d097b2-delete_snapshot" released by "delete_snapshot" :: held 2.204s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:50 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ffb3da30-3bbe-4f85-a284-953cab0a9324 Jul 21 19:08:50 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:51 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ffb3da30-3bbe-4f85-a284-953cab0a9324" returned: 0 in 0.293s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b365fd01-9095-4442-9eb4-daa2d2adde92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb3da30-3bbe-4f85-a284-953cab0a9324', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec0a54b-ae63-4a74-ac7d-66e33cd95867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:51 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Volume volume-ffb3da30-3bbe-4f85-a284-953cab0a9324 (ffb3da30-3bbe-4f85-a284-953cab0a9324): created successfully Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec0a54b-ae63-4a74-ac7d-66e33cd95867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Flow 'volume_create_manager' (093f5651-551a-482d-a9f8-9f7aad94e9ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:51 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-3fc871fe-0775-4a98-8d8a-cf9439374339 tempest-VolumesTransfersTest-3271704 None] Created volume successfully. Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] Acquiring lock "cinder-4851b4fc-0189-4c33-8171-60a8993bb208-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] Lock "cinder-4851b4fc-0189-4c33-8171-60a8993bb208-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] Acquiring lock "cinder-quobyte-fcbffd1f-8840-483a-ba01-9cc95ecebac5" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] Lock "cinder-quobyte-fcbffd1f-8840-483a-ba01-9cc95ecebac5" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] Acquiring lock "cinder-quobyte-4851b4fc-0189-4c33-8171-60a8993bb208" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] Lock "cinder-quobyte-4851b4fc-0189-4c33-8171-60a8993bb208" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] Deleting offline snapshot 4851b4fc-0189-4c33-8171-60a8993bb208 of volume fcbffd1f-8840-483a-ba01-9cc95ecebac5 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] snapshot_file for this snap is: volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[21389a7e-9e9d-4bec-9246-fbd638e27dba]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:51 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208 Jul 21 19:08:51 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:51 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208" returned: 0 in 0.452s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fe919f-f718-4e0d-a8eb-7aedc242f888]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] Acquiring lock "cinder-ffb3da30-3bbe-4f85-a284-953cab0a9324-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] Lock "cinder-ffb3da30-3bbe-4f85-a284-953cab0a9324-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] Acquiring lock "cinder-quobyte-ffb3da30-3bbe-4f85-a284-953cab0a9324" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] Lock "cinder-quobyte-ffb3da30-3bbe-4f85-a284-953cab0a9324" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:51 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5 Jul 21 19:08:51 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bac79fe-798d-4520-93e9-0cebd2a34ecd]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ffb3da30-3bbe-4f85-a284-953cab0a9324 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:52 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ffb3da30-3bbe-4f85-a284-953cab0a9324 Jul 21 19:08:52 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-47dcffc1-457b-4a46-8440-7b9feeeb877b tempest-SnapshotsActionsTest-444139151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-47dcffc1-457b-4a46-8440-7b9feeeb877b tempest-SnapshotsActionsTest-444139151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-47dcffc1-457b-4a46-8440-7b9feeeb877b tempest-SnapshotsActionsTest-444139151 None] Creating offline snapshot 68657292-8b77-4c00-a3f9-2ccdf0b2c5d7 of volume 8f0a0a04-ba62-46ab-b658-40a4a99fbf76 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:08:52 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[294d063e-9839-42fc-8e0f-ccb2df907c89]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47dcffc1-457b-4a46-8440-7b9feeeb877b tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:52 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5" returned: 0 in 0.553s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:52 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208 Jul 21 19:08:52 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:52 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a Jul 21 19:08:52 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:52 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ffb3da30-3bbe-4f85-a284-953cab0a9324" returned: 0 in 0.482s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ffb3da30-3bbe-4f85-a284-953cab0a9324 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:52 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ffb3da30-3bbe-4f85-a284-953cab0a9324 Jul 21 19:08:52 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:52 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47dcffc1-457b-4a46-8440-7b9feeeb877b tempest-SnapshotsActionsTest-444139151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a" returned: 0 in 0.463s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-47dcffc1-457b-4a46-8440-7b9feeeb877b tempest-SnapshotsActionsTest-444139151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47dcffc1-457b-4a46-8440-7b9feeeb877b tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:52 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208" returned: 0 in 0.452s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:52 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:52 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7 1G Jul 21 19:08:52 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ffb3da30-3bbe-4f85-a284-953cab0a9324" returned: 0 in 0.333s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:52 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208 Jul 21 19:08:52 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:52 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] Lock "cinder-quobyte-ffb3da30-3bbe-4f85-a284-953cab0a9324" released by "delete_volume" :: held 0.886s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:52 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] Created reservations ['22f9a1c4-3e32-45ce-a049-b738bc669bce', '3ca86d6e-a49a-49dd-8950-10f6da992244', '2f75c420-e614-4309-b08d-62c680a35730', 'db010bc6-6e0e-42b5-a500-0e419b2136b3'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:53 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5.4851b4fc-0189-4c33-8171-60a8993bb208" returned: 0 in 0.310s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] Lock "cinder-quobyte-4851b4fc-0189-4c33-8171-60a8993bb208" released by "_delete_snapshot" :: held 1.933s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] Lock "cinder-quobyte-fcbffd1f-8840-483a-ba01-9cc95ecebac5" released by "delete_snapshot" :: held 1.965s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:53 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:08:53 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:53 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47dcffc1-457b-4a46-8440-7b9feeeb877b tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7 1G" returned: 0 in 0.514s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47dcffc1-457b-4a46-8440-7b9feeeb877b tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] Created reservations ['a9b7242c-c154-48cd-9b98-639525422074', '2b28b5b1-ae88-4e11-a634-ac81791e47f8', '295d0d07-d352-427e-ba51-c51284a07580', '0fabbfb6-b47b-4fdf-8acd-9523b3dde865'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:53 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7 Jul 21 19:08:53 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:53 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] Delete snapshot completed successfully. Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8e79eca-aed8-4339-beb2-e3376ccee43f tempest-CinderUnicodeTest-887064997 None] Lock "cinder-4851b4fc-0189-4c33-8171-60a8993bb208-delete_snapshot" released by "delete_snapshot" :: held 2.222s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:53 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.285s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:08:53 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] Deleted volume successfully. Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e3e8210c-59f4-4b9f-b10f-3572bf026d51 tempest-VolumesTransfersTest-816362296 None] Lock "cinder-ffb3da30-3bbe-4f85-a284-953cab0a9324-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:53 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47dcffc1-457b-4a46-8440-7b9feeeb877b tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7" returned: 0 in 0.333s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:53 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-47dcffc1-457b-4a46-8440-7b9feeeb877b tempest-SnapshotsActionsTest-444139151 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7 is being set with open permissions: ugo+rw Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47dcffc1-457b-4a46-8440-7b9feeeb877b tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:53 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7 Jul 21 19:08:53 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:53 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47dcffc1-457b-4a46-8440-7b9feeeb877b tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7" returned: 0 in 0.251s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-47dcffc1-457b-4a46-8440-7b9feeeb877b tempest-SnapshotsActionsTest-444139151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.688s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:53 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-47dcffc1-457b-4a46-8440-7b9feeeb877b tempest-SnapshotsActionsTest-444139151 None] Create snapshot completed successfully Jul 21 19:08:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Acquiring lock "cinder-68657292-8b77-4c00-a3f9-2ccdf0b2c5d7-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] Acquiring lock "cinder-fcbffd1f-8840-483a-ba01-9cc95ecebac5-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-68657292-8b77-4c00-a3f9-2ccdf0b2c5d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Acquiring lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] Lock "cinder-fcbffd1f-8840-483a-ba01-9cc95ecebac5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Acquiring lock "cinder-quobyte-68657292-8b77-4c00-a3f9-2ccdf0b2c5d7" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-quobyte-68657292-8b77-4c00-a3f9-2ccdf0b2c5d7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Deleting offline snapshot 68657292-8b77-4c00-a3f9-2ccdf0b2c5d7 of volume 8f0a0a04-ba62-46ab-b658-40a4a99fbf76 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:08:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] snapshot_file for this snap is: volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:08:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] Acquiring lock "cinder-quobyte-fcbffd1f-8840-483a-ba01-9cc95ecebac5" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:08:54 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[526fedf2-e857-49d3-b338-b63a558de298]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] Lock "cinder-quobyte-fcbffd1f-8840-483a-ba01-9cc95ecebac5" acquired by "delete_volume" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:08:54 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a2a719-6120-4a17-a15e-ff8ceea7d39d]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:54 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7 Jul 21 19:08:54 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:54 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5 Jul 21 19:08:54 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:55 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7" returned: 0 in 0.469s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:55 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e8d151-a665-4216-9abf-8f6c34a23dba]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:08:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:55 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5" returned: 0 in 0.473s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:55 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5 Jul 21 19:08:55 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:55 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a Jul 21 19:08:55 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:55 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fcbffd1f-8840-483a-ba01-9cc95ecebac5" returned: 0 in 0.265s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] Lock "cinder-quobyte-fcbffd1f-8840-483a-ba01-9cc95ecebac5" released by "delete_volume" :: held 0.830s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:55 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a" returned: 0 in 0.399s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:08:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:55 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7 Jul 21 19:08:55 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:55 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7" returned: 0 in 0.422s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:55 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7 Jul 21 19:08:55 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:56 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.68657292-8b77-4c00-a3f9-2ccdf0b2c5d7" returned: 0 in 0.298s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-quobyte-68657292-8b77-4c00-a3f9-2ccdf0b2c5d7" released by "_delete_snapshot" :: held 1.711s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" released by "delete_snapshot" :: held 1.748s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:08:56 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] Created reservations ['2b47fe8d-727e-4936-8dfa-7425ee9f4e25', '072b72cc-4a2b-453e-babc-11a3bb0bb61e', '659ced8b-e8bb-450f-94c5-dfbff86fe18d', '48b5519b-31b4-4cfc-97e0-a5589df44b31'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:08:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:56 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:08:56 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:57 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.265s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:08:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:08:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:08:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:08:57 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Created reservations ['cbba2bc3-ea29-4c79-9f6a-1e8c2be35484', '9ce74c84-9a58-4392-9df4-15acbac51d76', '1effc956-4f08-4366-992e-0c4343896d7b', '911e36c2-b3f6-48bb-8485-e8ed38928bb6'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:08:58 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=105,cinder:SELECT=103,cinder:INSERT=34,cinder:DELETE=8 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:08:58 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=100,cinder:UPDATE=118,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:00 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:09:00 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] Acquiring lock "cinder-4cc18600-d1c4-4f73-b440-e5c45bddb8ce-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] Lock "cinder-4cc18600-d1c4-4f73-b440-e5c45bddb8ce-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:00 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Delete snapshot completed successfully. Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-71cc3474-dfa0-4597-9d51-ec506323ca29 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-68657292-8b77-4c00-a3f9-2ccdf0b2c5d7-delete_snapshot" released by "delete_snapshot" :: held 5.907s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] Acquiring lock "cinder-quobyte-4cc18600-d1c4-4f73-b440-e5c45bddb8ce" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] Lock "cinder-quobyte-4cc18600-d1c4-4f73-b440-e5c45bddb8ce" acquired by "delete_volume" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[e018d35a-b944-4000-857c-2b4642fc6f51]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4cc18600-d1c4-4f73-b440-e5c45bddb8ce {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:00 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.422s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:09:00 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] Deleted volume successfully. Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-30e5fe3f-7a13-493c-b89a-f41b4901a437 tempest-CinderUnicodeTest-887064997 None] Lock "cinder-fcbffd1f-8840-483a-ba01-9cc95ecebac5-delete_volume" released by "delete_volume" :: held 6.229s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:00 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4cc18600-d1c4-4f73-b440-e5c45bddb8ce Jul 21 19:09:00 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-69c4a7b4-b21c-4d28-b0d0-d7814ec95c7d tempest-SnapshotsActionsTest-444139151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-69c4a7b4-b21c-4d28-b0d0-d7814ec95c7d tempest-SnapshotsActionsTest-444139151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-69c4a7b4-b21c-4d28-b0d0-d7814ec95c7d tempest-SnapshotsActionsTest-444139151 None] Creating offline snapshot d1293e21-1d53-4086-b66f-d1f80989ccf8 of volume 8f0a0a04-ba62-46ab-b658-40a4a99fbf76 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[012e3ec7-1717-44aa-adae-734bb4a5f01b]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-69c4a7b4-b21c-4d28-b0d0-d7814ec95c7d tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:01 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a Jul 21 19:09:01 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:01 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-a0d8a65a-dfd4-45f9-bd24-f038f925e98e req-5bf4b9ff-e607-4846-b01f-6e469a0c36ae tempest-TestServerVolumeAttachmentScenario-1245275541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4cc18600-d1c4-4f73-b440-e5c45bddb8ce" returned: 0 in 0.659s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4cc18600-d1c4-4f73-b440-e5c45bddb8ce {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:01 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4cc18600-d1c4-4f73-b440-e5c45bddb8ce Jul 21 19:09:01 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:01 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-69c4a7b4-b21c-4d28-b0d0-d7814ec95c7d tempest-SnapshotsActionsTest-444139151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a" returned: 0 in 0.470s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-69c4a7b4-b21c-4d28-b0d0-d7814ec95c7d tempest-SnapshotsActionsTest-444139151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:09:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-69c4a7b4-b21c-4d28-b0d0-d7814ec95c7d tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:01 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8 1G Jul 21 19:09:01 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:01 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4cc18600-d1c4-4f73-b440-e5c45bddb8ce" returned: 0 in 0.351s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] Lock "cinder-quobyte-4cc18600-d1c4-4f73-b440-e5c45bddb8ce" released by "delete_volume" :: held 1.093s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:01 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] Created reservations ['36836e25-88df-4ade-af49-604427da55bc', '3796e28d-4f46-4a05-bdce-9f002a145057', '89606103-0275-4780-8375-b73459dbcd89', '1bbcb284-1425-4d65-863e-f2c0e41f5824'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:09:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:01 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:09:01 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:01 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-69c4a7b4-b21c-4d28-b0d0-d7814ec95c7d tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8 1G" returned: 0 in 0.561s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-69c4a7b4-b21c-4d28-b0d0-d7814ec95c7d tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:02 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8 Jul 21 19:09:02 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:02 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.320s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:02 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:09:02 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] Deleted volume successfully. Jul 21 19:09:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-20cba18b-81cb-4921-9454-e30e4bd578af tempest-CinderUnicodeTest-887064997 None] Lock "cinder-4cc18600-d1c4-4f73-b440-e5c45bddb8ce-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:02 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-69c4a7b4-b21c-4d28-b0d0-d7814ec95c7d tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8" returned: 0 in 0.355s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:02 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-69c4a7b4-b21c-4d28-b0d0-d7814ec95c7d tempest-SnapshotsActionsTest-444139151 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8 is being set with open permissions: ugo+rw Jul 21 19:09:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-69c4a7b4-b21c-4d28-b0d0-d7814ec95c7d tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:02 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8 Jul 21 19:09:02 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:02 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-69c4a7b4-b21c-4d28-b0d0-d7814ec95c7d tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8" returned: 0 in 0.281s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-69c4a7b4-b21c-4d28-b0d0-d7814ec95c7d tempest-SnapshotsActionsTest-444139151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.820s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-a0d8a65a-dfd4-45f9-bd24-f038f925e98e req-5bf4b9ff-e607-4846-b01f-6e469a0c36ae tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.493s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-a0d8a65a-dfd4-45f9-bd24-f038f925e98e req-5bf4b9ff-e607-4846-b01f-6e469a0c36ae tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:02 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-69c4a7b4-b21c-4d28-b0d0-d7814ec95c7d tempest-SnapshotsActionsTest-444139151 None] Create snapshot completed successfully Jul 21 19:09:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-a0d8a65a-dfd4-45f9-bd24-f038f925e98e req-5bf4b9ff-e607-4846-b01f-6e469a0c36ae tempest-TestServerVolumeAttachmentScenario-1245275541 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-ac37b25a-d757-42d9-837c-d192ef2198d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '218b3ab4-8d00-4e12-bbe9-bee6a76b4609', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:09:02 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-a0d8a65a-dfd4-45f9-bd24-f038f925e98e req-5bf4b9ff-e607-4846-b01f-6e469a0c36ae tempest-TestServerVolumeAttachmentScenario-1245275541 None] attachment_update completed successfully. Jul 21 19:09:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Acquiring lock "cinder-d1293e21-1d53-4086-b66f-d1f80989ccf8-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-d1293e21-1d53-4086-b66f-d1f80989ccf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Acquiring lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Acquiring lock "cinder-quobyte-d1293e21-1d53-4086-b66f-d1f80989ccf8" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-quobyte-d1293e21-1d53-4086-b66f-d1f80989ccf8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Deleting offline snapshot d1293e21-1d53-4086-b66f-d1f80989ccf8 of volume 8f0a0a04-ba62-46ab-b658-40a4a99fbf76 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:09:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] snapshot_file for this snap is: volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:09:03 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[1662d251-de59-4da7-a548-9c1e20dd1c30]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:03 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8 Jul 21 19:09:03 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:03 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8" returned: 0 in 0.630s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:09:03 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f078a9-387c-4bd8-bd09-9e9b589dcc5d]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:04 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a Jul 21 19:09:04 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:04 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a" returned: 0 in 0.572s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:09:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:04 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8 Jul 21 19:09:04 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:04 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8" returned: 0 in 0.472s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:04 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8 Jul 21 19:09:04 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:05 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.d1293e21-1d53-4086-b66f-d1f80989ccf8" returned: 0 in 0.380s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-quobyte-d1293e21-1d53-4086-b66f-d1f80989ccf8" released by "_delete_snapshot" :: held 2.235s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" released by "delete_snapshot" :: held 2.269s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:05 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Created reservations ['3b6536d3-e0f8-403c-87cf-c0a6d3388831', 'abfdc19c-4a7a-4ffc-8684-b4ef7627a117', '3c01bba4-fb23-4eb6-a9a8-5ed997d71480', 'b7fd7a26-c802-4422-8ded-e698a847e51b'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:09:05 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Delete snapshot completed successfully. Jul 21 19:09:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a5f16cb8-e31e-4bf7-a593-9be74db26591 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-d1293e21-1d53-4086-b66f-d1f80989ccf8-delete_snapshot" released by "delete_snapshot" :: held 2.500s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-deadff7a-a4f5-4c84-ab2b-8638ecb6856b tempest-SnapshotsActionsTest-444139151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-deadff7a-a4f5-4c84-ab2b-8638ecb6856b tempest-SnapshotsActionsTest-444139151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-deadff7a-a4f5-4c84-ab2b-8638ecb6856b tempest-SnapshotsActionsTest-444139151 None] Creating offline snapshot bc89e031-d206-4832-9c0b-abda41c54be2 of volume 8f0a0a04-ba62-46ab-b658-40a4a99fbf76 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:09:07 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2fd24a-423f-40ee-976d-061d499e3b50]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-deadff7a-a4f5-4c84-ab2b-8638ecb6856b tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:07 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a Jul 21 19:09:07 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:07 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-deadff7a-a4f5-4c84-ab2b-8638ecb6856b tempest-SnapshotsActionsTest-444139151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a" returned: 0 in 0.496s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-deadff7a-a4f5-4c84-ab2b-8638ecb6856b tempest-SnapshotsActionsTest-444139151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:09:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-deadff7a-a4f5-4c84-ab2b-8638ecb6856b tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:07 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2 1G Jul 21 19:09:07 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:08 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-deadff7a-a4f5-4c84-ab2b-8638ecb6856b tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2 1G" returned: 0 in 0.639s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-deadff7a-a4f5-4c84-ab2b-8638ecb6856b tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:08 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2 Jul 21 19:09:08 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:08 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-deadff7a-a4f5-4c84-ab2b-8638ecb6856b tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2" returned: 0 in 0.484s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:08 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-deadff7a-a4f5-4c84-ab2b-8638ecb6856b tempest-SnapshotsActionsTest-444139151 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2 is being set with open permissions: ugo+rw Jul 21 19:09:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-deadff7a-a4f5-4c84-ab2b-8638ecb6856b tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:08 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2 Jul 21 19:09:08 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:09 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-deadff7a-a4f5-4c84-ab2b-8638ecb6856b tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2" returned: 0 in 0.338s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-deadff7a-a4f5-4c84-ab2b-8638ecb6856b tempest-SnapshotsActionsTest-444139151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.136s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:09 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-deadff7a-a4f5-4c84-ab2b-8638ecb6856b tempest-SnapshotsActionsTest-444139151 None] Create snapshot completed successfully Jul 21 19:09:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Acquiring lock "cinder-bc89e031-d206-4832-9c0b-abda41c54be2-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-bc89e031-d206-4832-9c0b-abda41c54be2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Acquiring lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Acquiring lock "cinder-quobyte-bc89e031-d206-4832-9c0b-abda41c54be2" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-quobyte-bc89e031-d206-4832-9c0b-abda41c54be2" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Deleting offline snapshot bc89e031-d206-4832-9c0b-abda41c54be2 of volume 8f0a0a04-ba62-46ab-b658-40a4a99fbf76 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:09:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] snapshot_file for this snap is: volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:09:09 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f27e4cd-9067-43c5-872a-87ca5549b3b9]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-87e41600-5b60-4569-84b7-466a56f7248d req-89847a67-54a6-4ac5-828a-20878f8ad3c5 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-87e41600-5b60-4569-84b7-466a56f7248d req-89847a67-54a6-4ac5-828a-20878f8ad3c5 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-87e41600-5b60-4569-84b7-466a56f7248d req-89847a67-54a6-4ac5-828a-20878f8ad3c5 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-87e41600-5b60-4569-84b7-466a56f7248d req-89847a67-54a6-4ac5-828a-20878f8ad3c5 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-53e0d532-7903-488d-86c3-13042d32d7c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '984c5938-2ec5-4de4-aa5e-787a76856341', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:09:09 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2 Jul 21 19:09:09 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:09 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-87e41600-5b60-4569-84b7-466a56f7248d req-89847a67-54a6-4ac5-828a-20878f8ad3c5 tempest-TestServerVolumeAttachmentScenario-1245275541 None] attachment_update completed successfully. Jul 21 19:09:10 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2" returned: 0 in 0.634s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:09:10 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0b6358-f4d0-4d78-a1df-33c73579d338]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:10 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a Jul 21 19:09:10 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:10 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a" returned: 0 in 0.463s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:09:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:10 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2 Jul 21 19:09:10 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:11 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2" returned: 0 in 0.500s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:11 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2 Jul 21 19:09:11 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:11 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.bc89e031-d206-4832-9c0b-abda41c54be2" returned: 0 in 0.472s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-quobyte-bc89e031-d206-4832-9c0b-abda41c54be2" released by "_delete_snapshot" :: held 2.241s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" released by "delete_snapshot" :: held 2.286s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:11 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Created reservations ['d64cd20a-7ca9-41cf-81ce-627a55e25b69', 'ff6ff9b5-0b80-4ff6-9a8e-85d5758acce6', 'd9cd8c5b-44ad-4749-bf13-577efcee4d12', 'afacd8c9-1365-43cb-87ac-7afd489cad15'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:09:12 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Delete snapshot completed successfully. Jul 21 19:09:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9c264d10-ea14-4bd9-a402-bff5ada7c9e0 tempest-SnapshotsActionsTest-1921103891 None] Lock "cinder-bc89e031-d206-4832-9c0b-abda41c54be2-delete_snapshot" released by "delete_snapshot" :: held 2.544s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:13 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-759bf0f8-6f19-4540-98f5-c9cba29df164 req-e849dc39-94c9-4084-95aa-8649d412486a tempest-TestServerVolumeAttachmentScenario-1245275541 None] Terminate volume connection completed successfully. Jul 21 19:09:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-759bf0f8-6f19-4540-98f5-c9cba29df164 req-e849dc39-94c9-4084-95aa-8649d412486a tempest-TestServerVolumeAttachmentScenario-1245275541 None] Deleting attachment 984c5938-2ec5-4de4-aa5e-787a76856341. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:09:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] Acquiring lock "cinder-542a60a4-8259-4e9a-b204-9d986519026a-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] Lock "cinder-542a60a4-8259-4e9a-b204-9d986519026a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] Acquiring lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] Lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] Acquiring lock "cinder-quobyte-542a60a4-8259-4e9a-b204-9d986519026a" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] Lock "cinder-quobyte-542a60a4-8259-4e9a-b204-9d986519026a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] Deleting offline snapshot 542a60a4-8259-4e9a-b204-9d986519026a of volume 8f0a0a04-ba62-46ab-b658-40a4a99fbf76 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:09:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] snapshot_file for this snap is: volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:09:13 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[4883a147-a367-4f5d-a0f2-b396c751de53]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:13 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a Jul 21 19:09:13 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:14 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a" returned: 0 in 0.530s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:09:14 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c11d13-1c21-428e-b58f-9e6aef08c3b0]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:14 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76 Jul 21 19:09:14 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:14 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" returned: 0 in 0.725s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:14 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a Jul 21 19:09:14 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:15 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-fb0768f5-09ee-412b-8dcc-c5d887c6a913 req-01226beb-b752-4acd-b982-21cd833acbba tempest-TestServerVolumeAttachmentScenario-1245275541 None] Terminate volume connection completed successfully. Jul 21 19:09:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-fb0768f5-09ee-412b-8dcc-c5d887c6a913 req-01226beb-b752-4acd-b982-21cd833acbba tempest-TestServerVolumeAttachmentScenario-1245275541 None] Deleting attachment 218b3ab4-8d00-4e12-bbe9-bee6a76b4609. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:09:15 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a" returned: 0 in 0.625s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:15 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a Jul 21 19:09:15 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:15 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76.542a60a4-8259-4e9a-b204-9d986519026a" returned: 0 in 0.350s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] Lock "cinder-quobyte-542a60a4-8259-4e9a-b204-9d986519026a" released by "_delete_snapshot" :: held 2.455s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] Lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" released by "delete_snapshot" :: held 2.504s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:16 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] Created reservations ['55e883d1-90b7-4b25-8ee4-4eae46b9ca20', 'fd9cdb34-955f-441b-9f66-e1c96b407fee', '19cd815d-bc16-4ba8-b8e1-c77542f6ef20', '81fede77-2faa-4cbb-aec4-dafd9823ae7c'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:09:16 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] Delete snapshot completed successfully. Jul 21 19:09:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dbf540ce-55d0-48ca-8a07-2ba3f1d04e1e tempest-SnapshotsActionsTest-444139151 None] Lock "cinder-542a60a4-8259-4e9a-b204-9d986519026a-delete_snapshot" released by "delete_snapshot" :: held 2.899s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] Acquiring lock "cinder-8f0a0a04-ba62-46ab-b658-40a4a99fbf76-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] Lock "cinder-8f0a0a04-ba62-46ab-b658-40a4a99fbf76-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] Acquiring lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] Lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" acquired by "delete_volume" :: waited 0.036s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:17 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9085c8-57c7-499f-b4b2-724b11838f11]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:17 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76 Jul 21 19:09:17 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:18 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" returned: 0 in 0.728s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:18 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76 Jul 21 19:09:18 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:18 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" returned: 0 in 0.474s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] Lock "cinder-quobyte-8f0a0a04-ba62-46ab-b658-40a4a99fbf76" released by "delete_volume" :: held 1.319s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:18 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] Created reservations ['8e3f93c6-38ef-4d1e-97dc-2c04172440c2', '06fb3c64-756f-46b2-b8bc-aa9e37051f4f', '38e5aaab-bd67-4f0b-9995-09e72f26758f', '4ac28981-f194-4aeb-b702-fe3fad3561ea'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:09:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:18 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:09:18 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:19 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.329s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:19 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:09:19 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] Deleted volume successfully. Jul 21 19:09:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-61489ef4-3b56-4f3d-a2bb-aa1dda895e69 tempest-SnapshotsActionsTest-444139151 None] Lock "cinder-8f0a0a04-ba62-46ab-b658-40a4a99fbf76-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:19 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:09:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Flow 'volume_create_manager' (6dfb33e4-2397-4b28-9d1e-5487c2e95bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569250f1-dce7-4dd2-829b-bca6d0234bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569250f1-dce7-4dd2-829b-bca6d0234bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1191421636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299d1b5e3bf04657a820dbf16cd1f4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:20Z,use_quota=True,user_id='e3b1ca4bf11e4da2ae3048f4a330755e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90313a6c-17e6-4cad-9d06-8751865d6f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90313a6c-17e6-4cad-9d06-8751865d6f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ac01e9-0032-4298-9560-69aad8d107c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ac01e9-0032-4298-9560-69aad8d107c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85', 'volume_name': 'volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d2d98b-aabe-444f-8d2b-aebd3c011bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d2d98b-aabe-444f-8d2b-aebd3c011bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfa477a-bdce-410b-9231-96d001aaedf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:20 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Volume ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85', 'volume_size': 1} Jul 21 19:09:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1191421636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299d1b5e3bf04657a820dbf16cd1f4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:20Z,use_quota=True,user_id='e3b1ca4bf11e4da2ae3048f4a330755e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:09:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Creating volume ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:09:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:09:20 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:09:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:20 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 1073741824 Jul 21 19:09:20 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:20 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 1073741824" returned: 0 in 0.736s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:20 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 Jul 21 19:09:20 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:21 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" returned: 0 in 0.344s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:09:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfa477a-bdce-410b-9231-96d001aaedf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49fb59a9-b493-44e2-8e3a-186561398641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:21 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Volume volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 (ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85): created successfully Jul 21 19:09:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49fb59a9-b493-44e2-8e3a-186561398641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Flow 'volume_create_manager' (6dfb33e4-2397-4b28-9d1e-5487c2e95bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:21 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-35a4f3fd-c479-463f-ab76-6a293fab7229 tempest-VolumesActionsTest-1123029276 None] Created volume successfully. Jul 21 19:09:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Acquiring lock "cinder-53e0d532-7903-488d-86c3-13042d32d7c4-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "cinder-53e0d532-7903-488d-86c3-13042d32d7c4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Acquiring lock "cinder-quobyte-53e0d532-7903-488d-86c3-13042d32d7c4" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "cinder-quobyte-53e0d532-7903-488d-86c3-13042d32d7c4" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:22 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e67c4d0-6ec4-4eb3-8d2c-45a68224262a]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-53e0d532-7903-488d-86c3-13042d32d7c4 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:22 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-53e0d532-7903-488d-86c3-13042d32d7c4 Jul 21 19:09:22 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:22 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-53e0d532-7903-488d-86c3-13042d32d7c4" returned: 0 in 0.452s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-53e0d532-7903-488d-86c3-13042d32d7c4 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:22 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-53e0d532-7903-488d-86c3-13042d32d7c4 Jul 21 19:09:22 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:23 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-53e0d532-7903-488d-86c3-13042d32d7c4" returned: 0 in 0.349s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "cinder-quobyte-53e0d532-7903-488d-86c3-13042d32d7c4" released by "delete_volume" :: held 0.860s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Created reservations ['0671a644-2c31-469a-bba9-d27daa6243b9', '35d7b6d4-3cde-42c7-9472-8af835acbcb4', 'ae95fc91-e280-4140-89c5-348e466aa9be', '1a70ce98-7584-4a93-9ae6-dd7b6e53a4ad'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:23 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:09:23 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Acquiring lock "cinder-ac37b25a-d757-42d9-837c-d192ef2198d3-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "cinder-ac37b25a-d757-42d9-837c-d192ef2198d3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Acquiring lock "cinder-quobyte-ac37b25a-d757-42d9-837c-d192ef2198d3" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "cinder-quobyte-ac37b25a-d757-42d9-837c-d192ef2198d3" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a9a6a8-718d-4b09-b5ae-0e810032dc4e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac37b25a-d757-42d9-837c-d192ef2198d3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:23 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.394s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:09:23 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Deleted volume successfully. Jul 21 19:09:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-80e48947-d0c2-48cf-92c6-82bc9db75c66 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "cinder-53e0d532-7903-488d-86c3-13042d32d7c4-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:23 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac37b25a-d757-42d9-837c-d192ef2198d3 Jul 21 19:09:23 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:24 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac37b25a-d757-42d9-837c-d192ef2198d3" returned: 0 in 0.467s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac37b25a-d757-42d9-837c-d192ef2198d3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:24 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac37b25a-d757-42d9-837c-d192ef2198d3 Jul 21 19:09:24 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:24 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac37b25a-d757-42d9-837c-d192ef2198d3" returned: 0 in 0.362s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "cinder-quobyte-ac37b25a-d757-42d9-837c-d192ef2198d3" released by "delete_volume" :: held 0.900s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:24 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Created reservations ['74a7ef1a-45f4-40d3-8431-b1089e7e3e08', '10a5c7e0-4597-4471-b9e5-0336caafb52d', '6dd3454c-9c62-44c3-914d-f736e8a43f7e', '20855aeb-7623-4cfc-b280-7f039bbc4009'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:09:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:24 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:09:24 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:25 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.311s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:25 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:09:25 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Deleted volume successfully. Jul 21 19:09:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8d368b8-6ce8-44f9-9f03-5233b3ef4140 tempest-TestServerVolumeAttachmentScenario-1245275541 None] Lock "cinder-ac37b25a-d757-42d9-837c-d192ef2198d3-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8c503db0-9bd1-469a-a3ce-b3cfadb9b3a9 tempest-VolumesActionsTest-1123029276 None] Acquiring lock "cinder-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" by "attach_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8c503db0-9bd1-469a-a3ce-b3cfadb9b3a9 tempest-VolumesActionsTest-1123029276 None] Lock "cinder-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" acquired by "attach_volume" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:32 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8c503db0-9bd1-469a-a3ce-b3cfadb9b3a9 tempest-VolumesActionsTest-1123029276 None] Attaching volume ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 to instance f2e238fc-b022-4583-a817-1259ec2db7a8 at mountpoint /dev/vdb on host None. Jul 21 19:09:32 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8c503db0-9bd1-469a-a3ce-b3cfadb9b3a9 tempest-VolumesActionsTest-1123029276 None] Attach volume completed successfully. Jul 21 19:09:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8c503db0-9bd1-469a-a3ce-b3cfadb9b3a9 tempest-VolumesActionsTest-1123029276 None] Lock "cinder-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" released by "attach_volume" :: held 0.190s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8f38ef83-e34a-4d28-8e6e-6215b4646336 tempest-VolumesActionsTest-1123029276 None] Acquiring lock "cinder-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85-detach_volume" by "detach_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8f38ef83-e34a-4d28-8e6e-6215b4646336 tempest-VolumesActionsTest-1123029276 None] Lock "cinder-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:32 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8f38ef83-e34a-4d28-8e6e-6215b4646336 tempest-VolumesActionsTest-1123029276 None] Detaching volume ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 from instance f2e238fc-b022-4583-a817-1259ec2db7a8. Jul 21 19:09:32 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8f38ef83-e34a-4d28-8e6e-6215b4646336 tempest-VolumesActionsTest-1123029276 None] Detach volume completed successfully. Jul 21 19:09:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8f38ef83-e34a-4d28-8e6e-6215b4646336 tempest-VolumesActionsTest-1123029276 None] Lock "cinder-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85-detach_volume" released by "detach_volume" :: held 0.111s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:34 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:09:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Flow 'volume_create_manager' (c89f0166-dae3-49e7-9e34-1a277fdee126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb656a96-3581-4dce-868d-47f9ba0ff58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb656a96-3581-4dce-868d-47f9ba0ff58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-27236560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cddbb51-20be-4e17-ace8-2bbe6aaf9875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5112e1fc6b45c69de5320a714f1152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:35Z,use_quota=True,user_id='93b027279cd94bbdae2740d89d4fd9b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8b18e5-7ac4-4641-9fe9-7e7836b076b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8b18e5-7ac4-4641-9fe9-7e7836b076b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c733d081-5e97-4cb1-ac09-cb9c8a876a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c733d081-5e97-4cb1-ac09-cb9c8a876a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cddbb51-20be-4e17-ace8-2bbe6aaf9875', 'volume_name': 'volume-8cddbb51-20be-4e17-ace8-2bbe6aaf9875', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3cbf8d-10f4-41a0-8be7-8ab69c0e194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3cbf8d-10f4-41a0-8be7-8ab69c0e194e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4e5c7c-8801-40af-bb0f-ab9e10aaa27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:35 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Volume 8cddbb51-20be-4e17-ace8-2bbe6aaf9875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cddbb51-20be-4e17-ace8-2bbe6aaf9875', 'volume_size': 1} Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-27236560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cddbb51-20be-4e17-ace8-2bbe6aaf9875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5112e1fc6b45c69de5320a714f1152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:35Z,use_quota=True,user_id='93b027279cd94bbdae2740d89d4fd9b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Creating volume 8cddbb51-20be-4e17-ace8-2bbe6aaf9875 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:09:35 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8cddbb51-20be-4e17-ace8-2bbe6aaf9875 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:35 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8cddbb51-20be-4e17-ace8-2bbe6aaf9875 1073741824 Jul 21 19:09:35 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:35 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8cddbb51-20be-4e17-ace8-2bbe6aaf9875 1073741824" returned: 0 in 0.609s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8cddbb51-20be-4e17-ace8-2bbe6aaf9875 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:35 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8cddbb51-20be-4e17-ace8-2bbe6aaf9875 Jul 21 19:09:35 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:36 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8cddbb51-20be-4e17-ace8-2bbe6aaf9875" returned: 0 in 0.307s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:09:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4e5c7c-8801-40af-bb0f-ab9e10aaa27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cddbb51-20be-4e17-ace8-2bbe6aaf9875', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045dd85e-494f-44ca-8373-7aeec008a712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:36 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Volume volume-8cddbb51-20be-4e17-ace8-2bbe6aaf9875 (8cddbb51-20be-4e17-ace8-2bbe6aaf9875): created successfully Jul 21 19:09:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045dd85e-494f-44ca-8373-7aeec008a712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Flow 'volume_create_manager' (c89f0166-dae3-49e7-9e34-1a277fdee126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:36 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0ff6ef31-c589-4dc3-bd7b-3cf2bc7942d2 tempest-VolumesServicesTestJSON-668656446 None] Created volume successfully. Jul 21 19:09:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] Acquiring lock "cinder-8cddbb51-20be-4e17-ace8-2bbe6aaf9875-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] Lock "cinder-8cddbb51-20be-4e17-ace8-2bbe6aaf9875-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] Acquiring lock "cinder-quobyte-8cddbb51-20be-4e17-ace8-2bbe6aaf9875" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] Lock "cinder-quobyte-8cddbb51-20be-4e17-ace8-2bbe6aaf9875" acquired by "delete_volume" :: waited 0.026s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:37 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[df63a458-4f9b-437c-8ab5-123d9ac0c584]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8cddbb51-20be-4e17-ace8-2bbe6aaf9875 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:37 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8cddbb51-20be-4e17-ace8-2bbe6aaf9875 Jul 21 19:09:37 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:37 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8cddbb51-20be-4e17-ace8-2bbe6aaf9875" returned: 0 in 0.410s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8cddbb51-20be-4e17-ace8-2bbe6aaf9875 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:37 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8cddbb51-20be-4e17-ace8-2bbe6aaf9875 Jul 21 19:09:37 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:38 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8cddbb51-20be-4e17-ace8-2bbe6aaf9875" returned: 0 in 0.287s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:38 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] Lock "cinder-quobyte-8cddbb51-20be-4e17-ace8-2bbe6aaf9875" released by "delete_volume" :: held 0.756s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:38 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] Created reservations ['7a0bae57-06bd-4b24-9e7b-def2ad8c5d3c', '22bc780c-f6a5-41de-972a-47df9ecc7067', 'a7c434af-18ad-4ba1-aef3-84b883422d20', 'bd3d3d3d-0c73-40c1-aeb2-62d2a29e8271'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:09:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:38 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:09:38 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:38 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.447s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:38 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:09:38 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] Deleted volume successfully. Jul 21 19:09:38 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-05570b32-db1c-4706-aac9-4631f4475364 tempest-VolumesServicesTestJSON-668656446 None] Lock "cinder-8cddbb51-20be-4e17-ace8-2bbe6aaf9875-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ffebc7ce-e565-433d-a39e-b44c2653f3a7 tempest-VolumesActionsTest-1123029276 None] Acquiring lock "cinder-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" by "attach_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ffebc7ce-e565-433d-a39e-b44c2653f3a7 tempest-VolumesActionsTest-1123029276 None] Lock "cinder-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" acquired by "attach_volume" :: waited 0.037s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:47 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-ffebc7ce-e565-433d-a39e-b44c2653f3a7 tempest-VolumesActionsTest-1123029276 None] Attaching volume ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 to instance 138518d8-65c7-4238-a4ec-7de4637540e1 at mountpoint /dev/vdb on host None. Jul 21 19:09:47 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-ffebc7ce-e565-433d-a39e-b44c2653f3a7 tempest-VolumesActionsTest-1123029276 None] Attach volume completed successfully. Jul 21 19:09:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ffebc7ce-e565-433d-a39e-b44c2653f3a7 tempest-VolumesActionsTest-1123029276 None] Lock "cinder-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" released by "attach_volume" :: held 0.134s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9f7fe35b-237d-4ce4-bbc1-00f859b0a41a tempest-VolumesActionsTest-1123029276 None] Acquiring lock "cinder-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85-detach_volume" by "detach_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9f7fe35b-237d-4ce4-bbc1-00f859b0a41a tempest-VolumesActionsTest-1123029276 None] Lock "cinder-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:47 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-9f7fe35b-237d-4ce4-bbc1-00f859b0a41a tempest-VolumesActionsTest-1123029276 None] Detaching volume ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 from instance 138518d8-65c7-4238-a4ec-7de4637540e1. Jul 21 19:09:47 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-9f7fe35b-237d-4ce4-bbc1-00f859b0a41a tempest-VolumesActionsTest-1123029276 None] Detach volume completed successfully. Jul 21 19:09:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9f7fe35b-237d-4ce4-bbc1-00f859b0a41a tempest-VolumesActionsTest-1123029276 None] Lock "cinder-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85-detach_volume" released by "detach_volume" :: held 0.107s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2ecb4a90-f3aa-4ca5-9af5-4a98c5954a7e tempest-VolumesActionsTest-1123029276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2ecb4a90-f3aa-4ca5-9af5-4a98c5954a7e tempest-VolumesActionsTest-1123029276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:55 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[179c99d6-1151-4c86-9977-00e93ac9dfd5]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2ecb4a90-f3aa-4ca5-9af5-4a98c5954a7e tempest-VolumesActionsTest-1123029276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:55 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 Jul 21 19:09:55 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:56 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2ecb4a90-f3aa-4ca5-9af5-4a98c5954a7e tempest-VolumesActionsTest-1123029276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" returned: 0 in 0.449s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:56 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0437122-e1ed-4d40-bccb-9c8733f329f4]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2ecb4a90-f3aa-4ca5-9af5-4a98c5954a7e tempest-VolumesActionsTest-1123029276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:56 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 Jul 21 19:09:56 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:56 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2ecb4a90-f3aa-4ca5-9af5-4a98c5954a7e tempest-VolumesActionsTest-1123029276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" returned: 0 in 0.436s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2ecb4a90-f3aa-4ca5-9af5-4a98c5954a7e tempest-VolumesActionsTest-1123029276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.1012b5a9-6734-4425-afd3-a3bd29bff31amgbuy1cp.img {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:56 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.1012b5a9-6734-4425-afd3-a3bd29bff31amgbuy1cp.img Jul 21 19:09:56 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:09:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:09:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:09:57 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=76,cinder:UPDATE=76,cinder:INSERT=18,cinder:DELETE=6 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:10:01 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2ecb4a90-f3aa-4ca5-9af5-4a98c5954a7e tempest-VolumesActionsTest-1123029276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.1012b5a9-6734-4425-afd3-a3bd29bff31amgbuy1cp.img" returned: 0 in 5.248s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:01 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca287e57-b628-430e-a619-8dfeff022830]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2ecb4a90-f3aa-4ca5-9af5-4a98c5954a7e tempest-VolumesActionsTest-1123029276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:02 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 Jul 21 19:10:02 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:02 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2ecb4a90-f3aa-4ca5-9af5-4a98c5954a7e tempest-VolumesActionsTest-1123029276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" returned: 0 in 0.644s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:02 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-2ecb4a90-f3aa-4ca5-9af5-4a98c5954a7e tempest-VolumesActionsTest-1123029276 None] Image conversion details: src /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.1012b5a9-6734-4425-afd3-a3bd29bff31amgbuy1cp.img {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:10:02 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-2ecb4a90-f3aa-4ca5-9af5-4a98c5954a7e tempest-VolumesActionsTest-1123029276 None] Converted 1024.00 MB image at 195.07 MB/s Jul 21 19:10:02 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=83,cinder:UPDATE=87,cinder:DELETE=4,cinder:INSERT=20 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:10:02 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-2ecb4a90-f3aa-4ca5-9af5-4a98c5954a7e tempest-VolumesActionsTest-1123029276 None] 1012b5a9-6734-4425-afd3-a3bd29bff31a was raw, no need to convert to raw {{(pid=87570) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 21 19:10:12 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=1 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:10:17 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Flow 'volume_create_manager' (a91a211f-ab29-445e-a596-a26422dbbf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f58dde-bc12-4f36-97e8-35f2a42df0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f58dde-bc12-4f36-97e8-35f2a42df0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-351559875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dea1cbd-981f-40a4-a780-4a7d639e15db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ff6b4f39cb438fb5359cbdf296552a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:17Z,use_quota=True,user_id='b9aad67bdeeb4ea19fdd521b53d9d0b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a4414f-1144-441a-b241-586d0236eb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a4414f-1144-441a-b241-586d0236eb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f0a07f-335b-4ebf-b71a-4c615e31c241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:17 devstack cinder-volume[87570]: DEBUG cinder.image.glance [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Creating Keystone auth plugin from conf {{(pid=87570) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:10:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f0a07f-335b-4ebf-b71a-4c615e31c241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9dea1cbd-981f-40a4-a780-4a7d639e15db', 'volume_name': 'volume-9dea1cbd-981f-40a4-a780-4a7d639e15db', 'volume_size': 1, 'image_id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d5947bfd6bf45059ad4d24acd0d802c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'created_at': datetime.datetime(2026, 7, 21, 16, 54, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eadc174-a8c3-43fb-85f2-5a9c8ecdc0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eadc174-a8c3-43fb-85f2-5a9c8ecdc0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274b73d1-15cd-4aac-9126-9545a140e8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:18 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Volume 9dea1cbd-981f-40a4-a780-4a7d639e15db: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9dea1cbd-981f-40a4-a780-4a7d639e15db', 'volume_size': 1, 'image_id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d5947bfd6bf45059ad4d24acd0d802c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'created_at': datetime.datetime(2026, 7, 21, 16, 54, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 19:10:18 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Trying to clone 9dea1cbd-981f-40a4-a780-4a7d639e15db from image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}]). {{(pid=87570) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:10:18 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_wdsp_p_ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:10:18 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Image download 20.69 MB at 20.69 MB/s Jul 21 19:10:18 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[154d0f96-073f-4728-a262-b4c919165d3e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_wdsp_p_ddevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:18 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_wdsp_p_ddevstack@QuobyteHD Jul 21 19:10:18 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:19 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_wdsp_p_ddevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:19 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Temporary image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 is fetched for user b9aad67bdeeb4ea19fdd521b53d9d0b5. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:10:19 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9220ea44-c5bf-4673-923e-e348a4ff1890]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_wdsp_p_ddevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:19 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_wdsp_p_ddevstack@QuobyteHD Jul 21 19:10:19 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:19 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_wdsp_p_ddevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2ecb4a90-f3aa-4ca5-9af5-4a98c5954a7e tempest-VolumesActionsTest-1123029276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.731s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2ecb4a90-f3aa-4ca5-9af5-4a98c5954a7e tempest-VolumesActionsTest-1123029276 None] Uploaded volume to glance image-id: 1012b5a9-6734-4425-afd3-a3bd29bff31a. {{(pid=87570) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 21 19:10:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.699s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-351559875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dea1cbd-981f-40a4-a780-4a7d639e15db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ff6b4f39cb438fb5359cbdf296552a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:17Z,use_quota=True,user_id='b9aad67bdeeb4ea19fdd521b53d9d0b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:10:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Creating volume 9dea1cbd-981f-40a4-a780-4a7d639e15db {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:10:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:26 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:10:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:26 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db 1073741824 Jul 21 19:10:26 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:26 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-2ecb4a90-f3aa-4ca5-9af5-4a98c5954a7e tempest-VolumesActionsTest-1123029276 None] Copy volume to image completed successfully. Jul 21 19:10:26 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db 1073741824" returned: 0 in 0.487s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:26 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db Jul 21 19:10:26 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:27 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db" returned: 0 in 0.257s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:10:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:27 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Attempting download of 2235c2cf-4cba-41d7-9e54-acfbf60b7351 ((None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}])) to volume 9dea1cbd-981f-40a4-a780-4a7d639e15db. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:10:27 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b68a87-a885-4100-b556-6140c6658cc8]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_g6pvk6c1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:27 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_g6pvk6c1 Jul 21 19:10:27 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:27 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_g6pvk6c1" returned: 0 in 0.521s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_g6pvk6c1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:27 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_g6pvk6c1 Jul 21 19:10:27 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:28 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_g6pvk6c1" returned: 1 in 0.472s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_g6pvk6c1' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:10:28 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e9cf58-e881-40ba-949e-775c6f84509b]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_wdsp_p_ddevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:28 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_wdsp_p_ddevstack@QuobyteHD Jul 21 19:10:28 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:28 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_wdsp_p_ddevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:28 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] 2235c2cf-4cba-41d7-9e54-acfbf60b7351 was qcow2, converting to qcow2 {{(pid=87570) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:10:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_wdsp_p_ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:28 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_wdsp_p_ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db Jul 21 19:10:28 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:28 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9654f47a-5d90-45bf-852a-7d05c5b72882]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:28 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 Jul 21 19:10:28 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:29 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" returned: 0 in 0.415s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:29 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abc1317-de22-4433-86fe-9ad5c4df94a9]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:29 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 Jul 21 19:10:29 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:29 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" returned: 0 in 0.484s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.25cfedaf-b464-4bf5-b056-5d460a6f3d3dbv7ow7li.img {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:29 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.25cfedaf-b464-4bf5-b056-5d460a6f3d3dbv7ow7li.img Jul 21 19:10:29 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:32 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_wdsp_p_ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db" returned: 0 in 3.350s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:32 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_wdsp_p_ddevstack@QuobyteHD, size 112.00 MB, duration 3.35 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:10:32 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Converted 112.00 MB image at 33.41 MB/s Jul 21 19:10:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:32 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db 1G Jul 21 19:10:32 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:32 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db 1G" returned: 0 in 0.716s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:32 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Downloaded image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 ((None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}])) to volume 9dea1cbd-981f-40a4-a780-4a7d639e15db successfully. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:10:32 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Temporary image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 for user b9aad67bdeeb4ea19fdd521b53d9d0b5 is deleted. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:10:32 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Marking volume 9dea1cbd-981f-40a4-a780-4a7d639e15db as bootable. {{(pid=87570) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:10:32 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Copying metadata from image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 to 9dea1cbd-981f-40a4-a780-4a7d639e15db. {{(pid=87570) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:10:32 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Creating volume glance metadata for volume 9dea1cbd-981f-40a4-a780-4a7d639e15db backed by image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87570) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:10:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274b73d1-15cd-4aac-9126-9545a140e8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dea1cbd-981f-40a4-a780-4a7d639e15db', 'volume_size': 1, 'image_id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d5947bfd6bf45059ad4d24acd0d802c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'created_at': datetime.datetime(2026, 7, 21, 16, 54, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29005d49-5f02-42e0-8e1e-069ba6987748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:33 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Volume volume-9dea1cbd-981f-40a4-a780-4a7d639e15db (9dea1cbd-981f-40a4-a780-4a7d639e15db): created successfully Jul 21 19:10:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29005d49-5f02-42e0-8e1e-069ba6987748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Flow 'volume_create_manager' (a91a211f-ab29-445e-a596-a26422dbbf30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:33 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-5889dbef-91f7-4ba9-842c-9fd0f4ba0356 tempest-TestShelveInstance-2098619281 None] Created volume successfully. Jul 21 19:10:35 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.25cfedaf-b464-4bf5-b056-5d460a6f3d3dbv7ow7li.img" returned: 0 in 5.583s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:35 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[602c7f21-0589-4fe4-aa2d-53fdf13d7ba1]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:35 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 Jul 21 19:10:35 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:35 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" returned: 0 in 0.705s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:35 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] Image conversion details: src /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.25cfedaf-b464-4bf5-b056-5d460a6f3d3dbv7ow7li.img {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:10:35 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] Converted 1024.00 MB image at 183.32 MB/s Jul 21 19:10:35 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] 25cfedaf-b464-4bf5-b056-5d460a6f3d3d was raw, converting to qcow2 {{(pid=87570) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 21 19:10:35 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[0699eb88-4849-43e6-8814-9df08e074edf]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.25cfedaf-b464-4bf5-b056-5d460a6f3d3dbv7ow7li.img {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:36 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.25cfedaf-b464-4bf5-b056-5d460a6f3d3dbv7ow7li.img Jul 21 19:10:36 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:36 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.25cfedaf-b464-4bf5-b056-5d460a6f3d3dbv7ow7li.img" returned: 0 in 0.371s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.25cfedaf-b464-4bf5-b056-5d460a6f3d3dbv7ow7li.img {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:36 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.25cfedaf-b464-4bf5-b056-5d460a6f3d3dbv7ow7li.img Jul 21 19:10:36 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:36 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.25cfedaf-b464-4bf5-b056-5d460a6f3d3dbv7ow7li.img" returned: 1 in 0.411s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.25cfedaf-b464-4bf5-b056-5d460a6f3d3dbv7ow7li.img' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:10:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.25cfedaf-b464-4bf5-b056-5d460a6f3d3dbv7ow7li.img /opt/stack/data/cinder/conversion/vol_upload_rzf1456o {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:36 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.25cfedaf-b464-4bf5-b056-5d460a6f3d3dbv7ow7li.img /opt/stack/data/cinder/conversion/vol_upload_rzf1456o Jul 21 19:10:36 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:37 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.25cfedaf-b464-4bf5-b056-5d460a6f3d3dbv7ow7li.img /opt/stack/data/cinder/conversion/vol_upload_rzf1456o" returned: 0 in 0.363s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:37 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] Image conversion details: src /opt/stack/data/cinder/conversion/ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85.temp_image.25cfedaf-b464-4bf5-b056-5d460a6f3d3dbv7ow7li.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_rzf1456o {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:10:37 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 21 19:10:37 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[74942b4a-8e5b-4733-961f-de55a4deb0f6]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rzf1456o {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:37 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rzf1456o Jul 21 19:10:37 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:37 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rzf1456o" returned: 0 in 0.471s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-9aeacb85-eb6d-4378-9026-446f0554aca4 req-372fa37e-6dd9-45ea-98f7-9e49330179b6 tempest-TestShelveInstance-2098619281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.954s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] Uploaded volume to glance image-id: 25cfedaf-b464-4bf5-b056-5d460a6f3d3d. {{(pid=87570) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 21 19:10:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-9aeacb85-eb6d-4378-9026-446f0554aca4 req-372fa37e-6dd9-45ea-98f7-9e49330179b6 tempest-TestShelveInstance-2098619281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.582s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-9aeacb85-eb6d-4378-9026-446f0554aca4 req-372fa37e-6dd9-45ea-98f7-9e49330179b6 tempest-TestShelveInstance-2098619281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:39 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-181a6860-717c-4c56-8015-ea9ea35f12bd tempest-VolumesActionsTest-1123029276 None] Copy volume to image completed successfully. Jul 21 19:10:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-9aeacb85-eb6d-4378-9026-446f0554aca4 req-372fa37e-6dd9-45ea-98f7-9e49330179b6 tempest-TestShelveInstance-2098619281 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-9dea1cbd-981f-40a4-a780-4a7d639e15db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca54f968-2e48-4c6e-bf0e-78cccd2c33eb', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:10:39 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-9aeacb85-eb6d-4378-9026-446f0554aca4 req-372fa37e-6dd9-45ea-98f7-9e49330179b6 tempest-TestShelveInstance-2098619281 None] attachment_update completed successfully. Jul 21 19:10:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] Acquiring lock "cinder-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] Lock "cinder-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] Acquiring lock "cinder-quobyte-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] Lock "cinder-quobyte-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" acquired by "delete_volume" :: waited 0.019s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:41 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e7a385-a212-4a4b-b01c-fa285d2bd48f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:41 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 Jul 21 19:10:41 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:42 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" returned: 0 in 0.682s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:42 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85 Jul 21 19:10:42 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:42 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" returned: 0 in 0.370s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] Lock "cinder-quobyte-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85" released by "delete_volume" :: held 1.132s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:42 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] Created reservations ['41a24102-3e11-4042-9069-9bb2a8f5ad82', '1c81254d-a677-436f-87c2-c53b58d24464', '3256d064-01db-4218-8097-dabc18209a9e', 'd6a8bb30-6922-413a-afc3-9fe90a561640'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:43 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:10:43 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:43 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.536s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:43 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:43 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] Deleted volume successfully. Jul 21 19:10:43 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-60a0360e-27a6-492d-9fb6-147217bfe060 tempest-VolumesActionsTest-1123029276 None] Lock "cinder-ea4e17ae-94ee-44d8-a1bb-bf4873c0cf85-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:53 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=15,cinder:SELECT=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:10:53 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Flow 'volume_create_manager' (a95a5cf6-a9f1-4983-aa8b-baadf4009150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9bcdbb-cc5e-4386-978b-af4d28a67334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9bcdbb-cc5e-4386-978b-af4d28a67334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1329369476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20f0b865-d6ad-4722-9237-387cf3850940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bffa966f5894d8b89cc0689d34d7f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:54Z,use_quota=True,user_id='652cf16568e54156bce558e9e3635244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2270040e-6ba7-4625-b8e4-573e3397198f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2270040e-6ba7-4625-b8e4-573e3397198f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a085831f-9ca1-4526-98fb-397e0a9ed8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a085831f-9ca1-4526-98fb-397e0a9ed8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20f0b865-d6ad-4722-9237-387cf3850940', 'volume_name': 'volume-20f0b865-d6ad-4722-9237-387cf3850940', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c95e7cd-3ec4-46f9-96e5-5a623d261d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c95e7cd-3ec4-46f9-96e5-5a623d261d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf5c8a2b-a7b2-458c-8f03-23f48fcfc77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:54 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Volume 20f0b865-d6ad-4722-9237-387cf3850940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20f0b865-d6ad-4722-9237-387cf3850940', 'volume_size': 1} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1329369476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20f0b865-d6ad-4722-9237-387cf3850940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bffa966f5894d8b89cc0689d34d7f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:54Z,use_quota=True,user_id='652cf16568e54156bce558e9e3635244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Creating volume 20f0b865-d6ad-4722-9237-387cf3850940 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:54 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:10:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-20f0b865-d6ad-4722-9237-387cf3850940 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:54 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-20f0b865-d6ad-4722-9237-387cf3850940 1073741824 Jul 21 19:10:54 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:55 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-20f0b865-d6ad-4722-9237-387cf3850940 1073741824" returned: 0 in 1.123s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-20f0b865-d6ad-4722-9237-387cf3850940 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:55 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-20f0b865-d6ad-4722-9237-387cf3850940 Jul 21 19:10:55 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:55 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-20f0b865-d6ad-4722-9237-387cf3850940" returned: 0 in 0.389s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:10:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf5c8a2b-a7b2-458c-8f03-23f48fcfc77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20f0b865-d6ad-4722-9237-387cf3850940', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85faf661-73f9-448a-a65c-d27a4c7602fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:55 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Volume volume-20f0b865-d6ad-4722-9237-387cf3850940 (20f0b865-d6ad-4722-9237-387cf3850940): created successfully Jul 21 19:10:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85faf661-73f9-448a-a65c-d27a4c7602fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Flow 'volume_create_manager' (a95a5cf6-a9f1-4983-aa8b-baadf4009150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:55 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-7ee1f46f-903b-4ef8-bd8a-de3f4a9a5484 tempest-VolumesActionsTest-913167815 None] Created volume successfully. Jul 21 19:10:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-31018f95-448a-4c46-918d-d8681b4a66c0 tempest-VolumesActionsTest-913167815 None] Acquiring lock "cinder-20f0b865-d6ad-4722-9237-387cf3850940" by "attach_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-31018f95-448a-4c46-918d-d8681b4a66c0 tempest-VolumesActionsTest-913167815 None] Lock "cinder-20f0b865-d6ad-4722-9237-387cf3850940" acquired by "attach_volume" :: waited 0.043s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:56 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-31018f95-448a-4c46-918d-d8681b4a66c0 tempest-VolumesActionsTest-913167815 None] Attaching volume 20f0b865-d6ad-4722-9237-387cf3850940 to instance 757aebb3-985f-44f8-b062-69081840328c at mountpoint /dev/vdb on host None. Jul 21 19:10:56 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-31018f95-448a-4c46-918d-d8681b4a66c0 tempest-VolumesActionsTest-913167815 None] Attach volume completed successfully. Jul 21 19:10:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-31018f95-448a-4c46-918d-d8681b4a66c0 tempest-VolumesActionsTest-913167815 None] Lock "cinder-20f0b865-d6ad-4722-9237-387cf3850940" released by "attach_volume" :: held 0.142s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:10:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:56 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:10:56 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:57 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.536s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:10:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:10:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:10:57 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f031adb8-77a5-48a0-a3e7-1058c69fc218 tempest-VolumesActionsTest-1704893228 None] Terminate volume connection completed successfully. Jul 21 19:10:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f031adb8-77a5-48a0-a3e7-1058c69fc218 tempest-VolumesActionsTest-1704893228 None] Acquiring lock "cinder-20f0b865-d6ad-4722-9237-387cf3850940-detach_volume" by "detach_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f031adb8-77a5-48a0-a3e7-1058c69fc218 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-20f0b865-d6ad-4722-9237-387cf3850940-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:57 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f031adb8-77a5-48a0-a3e7-1058c69fc218 tempest-VolumesActionsTest-1704893228 None] Detaching volume 20f0b865-d6ad-4722-9237-387cf3850940 from instance 757aebb3-985f-44f8-b062-69081840328c. Jul 21 19:10:57 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f031adb8-77a5-48a0-a3e7-1058c69fc218 tempest-VolumesActionsTest-1704893228 None] Detach volume completed successfully. Jul 21 19:10:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f031adb8-77a5-48a0-a3e7-1058c69fc218 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-20f0b865-d6ad-4722-9237-387cf3850940-detach_volume" released by "detach_volume" :: held 0.133s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d4ffd589-8da5-429b-b9ae-d7765ae903e6 tempest-VolumesActionsTest-913167815 None] Acquiring lock "cinder-20f0b865-d6ad-4722-9237-387cf3850940-detach_volume" by "detach_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d4ffd589-8da5-429b-b9ae-d7765ae903e6 tempest-VolumesActionsTest-913167815 None] Lock "cinder-20f0b865-d6ad-4722-9237-387cf3850940-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:58 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-d4ffd589-8da5-429b-b9ae-d7765ae903e6 tempest-VolumesActionsTest-913167815 None] Volume detach called, but volume not attached. Jul 21 19:10:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d4ffd589-8da5-429b-b9ae-d7765ae903e6 tempest-VolumesActionsTest-913167815 None] Lock "cinder-20f0b865-d6ad-4722-9237-387cf3850940-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] Acquiring lock "cinder-20f0b865-d6ad-4722-9237-387cf3850940-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] Lock "cinder-20f0b865-d6ad-4722-9237-387cf3850940-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] Acquiring lock "cinder-quobyte-20f0b865-d6ad-4722-9237-387cf3850940" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] Lock "cinder-quobyte-20f0b865-d6ad-4722-9237-387cf3850940" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:58 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[471b0ab0-410d-4d24-9e3d-f6d59dd6d9c0]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-20f0b865-d6ad-4722-9237-387cf3850940 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:59 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-20f0b865-d6ad-4722-9237-387cf3850940 Jul 21 19:10:59 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:59 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-20f0b865-d6ad-4722-9237-387cf3850940" returned: 0 in 0.529s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-20f0b865-d6ad-4722-9237-387cf3850940 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:59 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-20f0b865-d6ad-4722-9237-387cf3850940 Jul 21 19:10:59 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:59 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-20f0b865-d6ad-4722-9237-387cf3850940" returned: 0 in 0.418s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:59 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] Lock "cinder-quobyte-20f0b865-d6ad-4722-9237-387cf3850940" released by "delete_volume" :: held 1.038s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:59 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] Created reservations ['98cfabbc-7a4a-49f6-9b70-89f8846a5fb5', '6c9367f8-e34f-4c69-b21b-bc8248145e09', '0938cfa3-b1fa-4571-9dc0-2a3e723af8e8', '0f40b606-7541-4217-a4ff-2a65c30669f0'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:00 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:11:00 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:00 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.410s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:00 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:00 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] Deleted volume successfully. Jul 21 19:11:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d1e1332b-34e7-4869-93fe-db880acffd5b tempest-VolumesActionsTest-913167815 None] Lock "cinder-20f0b865-d6ad-4722-9237-387cf3850940-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Flow 'volume_create_manager' (ed6cf9c4-ca8f-4805-8c1e-14d89bf9830d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3813ba45-79b5-449b-98ed-c76d5322e150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3813ba45-79b5-449b-98ed-c76d5322e150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-123960500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b37175d-8830-4bdb-8555-13a193afd935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27fcb881d08a481a92de83e59561f436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:02Z,use_quota=True,user_id='d949cbd90607425996d13b883affa604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d39b2b-bd1a-4c97-b5e0-8b5d44e72335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d39b2b-bd1a-4c97-b5e0-8b5d44e72335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28769069-058c-4cc8-b19f-62c653eec583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28769069-058c-4cc8-b19f-62c653eec583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b37175d-8830-4bdb-8555-13a193afd935', 'volume_name': 'volume-8b37175d-8830-4bdb-8555-13a193afd935', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d289ad9c-a170-42fb-b1b4-70db1d9beafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d289ad9c-a170-42fb-b1b4-70db1d9beafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b93b65-80ee-468b-b2e8-2a1c4dc56ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:02 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Volume 8b37175d-8830-4bdb-8555-13a193afd935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b37175d-8830-4bdb-8555-13a193afd935', 'volume_size': 1} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-123960500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b37175d-8830-4bdb-8555-13a193afd935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27fcb881d08a481a92de83e59561f436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:02Z,use_quota=True,user_id='d949cbd90607425996d13b883affa604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Creating volume 8b37175d-8830-4bdb-8555-13a193afd935 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:02 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:11:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8b37175d-8830-4bdb-8555-13a193afd935 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:02 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8b37175d-8830-4bdb-8555-13a193afd935 1073741824 Jul 21 19:11:02 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:03 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8b37175d-8830-4bdb-8555-13a193afd935 1073741824" returned: 0 in 0.836s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8b37175d-8830-4bdb-8555-13a193afd935 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:03 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8b37175d-8830-4bdb-8555-13a193afd935 Jul 21 19:11:03 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:03 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8b37175d-8830-4bdb-8555-13a193afd935" returned: 0 in 0.348s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b93b65-80ee-468b-b2e8-2a1c4dc56ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b37175d-8830-4bdb-8555-13a193afd935', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a24e47-8546-4470-aec7-8f778d09b0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:03 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Volume volume-8b37175d-8830-4bdb-8555-13a193afd935 (8b37175d-8830-4bdb-8555-13a193afd935): created successfully Jul 21 19:11:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a24e47-8546-4470-aec7-8f778d09b0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Flow 'volume_create_manager' (ed6cf9c4-ca8f-4805-8c1e-14d89bf9830d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:03 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f4349a14-6587-44d5-889e-cac2ddda8160 tempest-VolumesNegativeTest-1992664903 None] Created volume successfully. Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Flow 'volume_create_manager' (c124a081-2976-4372-a207-bcc2c5777c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a70020f-b06b-4500-9286-65eb86da7377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a70020f-b06b-4500-9286-65eb86da7377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-920415288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb3549b-6754-4699-99a0-90f0ca9df494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bffa966f5894d8b89cc0689d34d7f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:05Z,use_quota=True,user_id='652cf16568e54156bce558e9e3635244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542aa3d2-ade2-480d-9d3a-e2672050f63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542aa3d2-ade2-480d-9d3a-e2672050f63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df556f70-4668-43dc-8c23-ae1988bc72c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df556f70-4668-43dc-8c23-ae1988bc72c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adb3549b-6754-4699-99a0-90f0ca9df494', 'volume_name': 'volume-adb3549b-6754-4699-99a0-90f0ca9df494', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (651fe18a-facc-4a6f-af3f-5790a9b17cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (651fe18a-facc-4a6f-af3f-5790a9b17cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027d16f8-b2c4-40c0-9b3f-70894b608e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:05 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Volume adb3549b-6754-4699-99a0-90f0ca9df494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adb3549b-6754-4699-99a0-90f0ca9df494', 'volume_size': 1} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-920415288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb3549b-6754-4699-99a0-90f0ca9df494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bffa966f5894d8b89cc0689d34d7f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:05Z,use_quota=True,user_id='652cf16568e54156bce558e9e3635244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Creating volume adb3549b-6754-4699-99a0-90f0ca9df494 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:05 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-adb3549b-6754-4699-99a0-90f0ca9df494 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:05 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-adb3549b-6754-4699-99a0-90f0ca9df494 1073741824 Jul 21 19:11:05 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:05 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-adb3549b-6754-4699-99a0-90f0ca9df494 1073741824" returned: 0 in 0.592s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-adb3549b-6754-4699-99a0-90f0ca9df494 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:05 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-adb3549b-6754-4699-99a0-90f0ca9df494 Jul 21 19:11:05 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:06 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-adb3549b-6754-4699-99a0-90f0ca9df494" returned: 0 in 0.286s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027d16f8-b2c4-40c0-9b3f-70894b608e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb3549b-6754-4699-99a0-90f0ca9df494', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f6fbce-9a39-4f94-9cd0-8f6ea1d3ec23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:06 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Volume volume-adb3549b-6754-4699-99a0-90f0ca9df494 (adb3549b-6754-4699-99a0-90f0ca9df494): created successfully Jul 21 19:11:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f6fbce-9a39-4f94-9cd0-8f6ea1d3ec23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Flow 'volume_create_manager' (c124a081-2976-4372-a207-bcc2c5777c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:06 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-bbfdcba6-623f-486c-a7f0-d19841965c43 tempest-VolumesActionsTest-913167815 None] Created volume successfully. Jul 21 19:11:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] Acquiring lock "cinder-adb3549b-6754-4699-99a0-90f0ca9df494-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-adb3549b-6754-4699-99a0-90f0ca9df494-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] Acquiring lock "cinder-quobyte-adb3549b-6754-4699-99a0-90f0ca9df494" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-quobyte-adb3549b-6754-4699-99a0-90f0ca9df494" acquired by "delete_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:07 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[de431a3f-3e04-4fec-a183-1440b936386a]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-adb3549b-6754-4699-99a0-90f0ca9df494 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:07 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-adb3549b-6754-4699-99a0-90f0ca9df494 Jul 21 19:11:07 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:07 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-adb3549b-6754-4699-99a0-90f0ca9df494" returned: 0 in 0.439s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-adb3549b-6754-4699-99a0-90f0ca9df494 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:07 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-adb3549b-6754-4699-99a0-90f0ca9df494 Jul 21 19:11:07 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:08 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-adb3549b-6754-4699-99a0-90f0ca9df494" returned: 0 in 0.260s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-quobyte-adb3549b-6754-4699-99a0-90f0ca9df494" released by "delete_volume" :: held 0.755s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:08 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] Created reservations ['a358c8d5-e9e3-48ac-9374-8a4f18695216', 'f96d91f3-5914-4d26-aab2-268b1914c448', '2a106e30-d06b-4996-94a2-476dd53d832d', '68c7f057-b9df-4822-bd6a-15cf726e15a4'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:08 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:11:08 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:08 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.313s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:08 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:08 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] Deleted volume successfully. Jul 21 19:11:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-10cc82fa-a2dd-48fd-8e8d-7f621d028928 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-adb3549b-6754-4699-99a0-90f0ca9df494-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Flow 'volume_create_manager' (032ce03e-5604-4b3b-a99a-90b93b6f595f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6e317b-ba42-4dc2-a305-aff8c191b4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6e317b-ba42-4dc2-a305-aff8c191b4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1758561919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc8ee02-7fd1-4e40-925a-8de462c26ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bffa966f5894d8b89cc0689d34d7f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:09Z,use_quota=True,user_id='652cf16568e54156bce558e9e3635244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3c3525-78aa-4e2d-aad3-d7355f38dd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3c3525-78aa-4e2d-aad3-d7355f38dd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc51891f-5d7e-477e-8b52-37ecf86d6290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc51891f-5d7e-477e-8b52-37ecf86d6290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dc8ee02-7fd1-4e40-925a-8de462c26ad9', 'volume_name': 'volume-5dc8ee02-7fd1-4e40-925a-8de462c26ad9', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e40d63e-5f81-43b7-a498-34dd52e177a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e40d63e-5f81-43b7-a498-34dd52e177a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae9a86c-6489-4a5e-b42b-6afb32bb1156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:09 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Volume 5dc8ee02-7fd1-4e40-925a-8de462c26ad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dc8ee02-7fd1-4e40-925a-8de462c26ad9', 'volume_size': 1} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1758561919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc8ee02-7fd1-4e40-925a-8de462c26ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bffa966f5894d8b89cc0689d34d7f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:09Z,use_quota=True,user_id='652cf16568e54156bce558e9e3635244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Creating volume 5dc8ee02-7fd1-4e40-925a-8de462c26ad9 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:09 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:11:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5dc8ee02-7fd1-4e40-925a-8de462c26ad9 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:09 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5dc8ee02-7fd1-4e40-925a-8de462c26ad9 1073741824 Jul 21 19:11:09 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:10 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5dc8ee02-7fd1-4e40-925a-8de462c26ad9 1073741824" returned: 0 in 0.631s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5dc8ee02-7fd1-4e40-925a-8de462c26ad9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:10 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5dc8ee02-7fd1-4e40-925a-8de462c26ad9 Jul 21 19:11:10 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:10 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5dc8ee02-7fd1-4e40-925a-8de462c26ad9" returned: 0 in 0.393s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae9a86c-6489-4a5e-b42b-6afb32bb1156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dc8ee02-7fd1-4e40-925a-8de462c26ad9', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152f88cc-50b9-40c5-bca4-693c11759c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:10 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Volume volume-5dc8ee02-7fd1-4e40-925a-8de462c26ad9 (5dc8ee02-7fd1-4e40-925a-8de462c26ad9): created successfully Jul 21 19:11:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152f88cc-50b9-40c5-bca4-693c11759c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Flow 'volume_create_manager' (032ce03e-5604-4b3b-a99a-90b93b6f595f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:10 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-22c7d496-e5f6-45b6-b72f-bde043a21351 tempest-VolumesActionsTest-913167815 None] Created volume successfully. Jul 21 19:11:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] Acquiring lock "cinder-5dc8ee02-7fd1-4e40-925a-8de462c26ad9-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-5dc8ee02-7fd1-4e40-925a-8de462c26ad9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] Acquiring lock "cinder-quobyte-5dc8ee02-7fd1-4e40-925a-8de462c26ad9" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-quobyte-5dc8ee02-7fd1-4e40-925a-8de462c26ad9" acquired by "delete_volume" :: waited 0.025s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:11 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[083c61fc-d9cd-4222-8990-ca23bdedc55b]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5dc8ee02-7fd1-4e40-925a-8de462c26ad9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:12 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5dc8ee02-7fd1-4e40-925a-8de462c26ad9 Jul 21 19:11:12 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:12 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5dc8ee02-7fd1-4e40-925a-8de462c26ad9" returned: 0 in 0.616s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5dc8ee02-7fd1-4e40-925a-8de462c26ad9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:12 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5dc8ee02-7fd1-4e40-925a-8de462c26ad9 Jul 21 19:11:12 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:12 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5dc8ee02-7fd1-4e40-925a-8de462c26ad9" returned: 0 in 0.273s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-quobyte-5dc8ee02-7fd1-4e40-925a-8de462c26ad9" released by "delete_volume" :: held 0.984s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:12 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=47,cinder:INSERT=19,cinder:UPDATE=46,cinder:DELETE=4 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:11:12 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] Created reservations ['6fb3848d-ebe9-48b3-b215-eb43a98e51a3', '2500b069-2b0c-4922-8ca1-c7f4fbf209ad', 'a99afd50-d2c4-43f9-93d3-533c2e19dba7', 'fb085fb2-492c-46bf-93c7-fe4cf7021043'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:13 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:11:13 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:13 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.341s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:13 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] Deleted volume successfully. Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8fe72aa4-56a7-466c-90e4-91ed0fb772d6 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-5dc8ee02-7fd1-4e40-925a-8de462c26ad9-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Flow 'volume_create_manager' (b115fcbd-a948-4d0e-831e-f98409db9b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54220f03-2914-4b50-92c2-b13ce0fc2380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54220f03-2914-4b50-92c2-b13ce0fc2380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-79994140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d062b82-2419-4e6e-937f-e0566b3f80de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bffa966f5894d8b89cc0689d34d7f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:14Z,use_quota=True,user_id='652cf16568e54156bce558e9e3635244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6823caa8-b761-4946-9a4e-9300df8df18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6823caa8-b761-4946-9a4e-9300df8df18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9259d761-a2d2-41b4-b225-450b379165fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9259d761-a2d2-41b4-b225-450b379165fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d062b82-2419-4e6e-937f-e0566b3f80de', 'volume_name': 'volume-5d062b82-2419-4e6e-937f-e0566b3f80de', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db554b0-64c8-4b59-8a17-9c7c74e88f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db554b0-64c8-4b59-8a17-9c7c74e88f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0478b84d-78bb-4f4a-aa00-9657b65a05e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:13 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Volume 5d062b82-2419-4e6e-937f-e0566b3f80de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d062b82-2419-4e6e-937f-e0566b3f80de', 'volume_size': 1} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-79994140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d062b82-2419-4e6e-937f-e0566b3f80de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bffa966f5894d8b89cc0689d34d7f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:14Z,use_quota=True,user_id='652cf16568e54156bce558e9e3635244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Creating volume 5d062b82-2419-4e6e-937f-e0566b3f80de {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:14 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:11:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5d062b82-2419-4e6e-937f-e0566b3f80de 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:14 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5d062b82-2419-4e6e-937f-e0566b3f80de 1073741824 Jul 21 19:11:14 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:14 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5d062b82-2419-4e6e-937f-e0566b3f80de 1073741824" returned: 0 in 0.812s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5d062b82-2419-4e6e-937f-e0566b3f80de {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:14 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5d062b82-2419-4e6e-937f-e0566b3f80de Jul 21 19:11:14 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:15 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5d062b82-2419-4e6e-937f-e0566b3f80de" returned: 0 in 0.353s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:15 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0478b84d-78bb-4f4a-aa00-9657b65a05e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d062b82-2419-4e6e-937f-e0566b3f80de', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aeb521d-c2cb-4f96-b131-87e62f76108d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:15 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Volume volume-5d062b82-2419-4e6e-937f-e0566b3f80de (5d062b82-2419-4e6e-937f-e0566b3f80de): created successfully Jul 21 19:11:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aeb521d-c2cb-4f96-b131-87e62f76108d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Flow 'volume_create_manager' (b115fcbd-a948-4d0e-831e-f98409db9b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:15 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-ef0d30ff-88d6-46f3-bd7c-36d30afa175c tempest-VolumesActionsTest-913167815 None] Created volume successfully. Jul 21 19:11:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] Acquiring lock "cinder-5d062b82-2419-4e6e-937f-e0566b3f80de-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-5d062b82-2419-4e6e-937f-e0566b3f80de-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] Acquiring lock "cinder-quobyte-5d062b82-2419-4e6e-937f-e0566b3f80de" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-quobyte-5d062b82-2419-4e6e-937f-e0566b3f80de" acquired by "delete_volume" :: waited 0.019s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:16 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[475c927a-78ca-4b70-b54c-2c2c2cf43a81]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5d062b82-2419-4e6e-937f-e0566b3f80de {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:16 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5d062b82-2419-4e6e-937f-e0566b3f80de Jul 21 19:11:16 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:16 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5d062b82-2419-4e6e-937f-e0566b3f80de" returned: 0 in 0.503s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5d062b82-2419-4e6e-937f-e0566b3f80de {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:16 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5d062b82-2419-4e6e-937f-e0566b3f80de Jul 21 19:11:16 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:17 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5d062b82-2419-4e6e-937f-e0566b3f80de" returned: 0 in 0.278s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-quobyte-5d062b82-2419-4e6e-937f-e0566b3f80de" released by "delete_volume" :: held 0.840s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:17 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] Created reservations ['1c89bd58-92b0-44bd-b45d-d2ecd15d4b77', '0e874b51-ade3-44ed-b720-7aa2ad131e77', 'ce60457a-021c-47c4-ae7f-a7a4a716ac03', 'cbdc308c-c02c-4a24-b046-40b75e28d9f4'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:17 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:11:17 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:17 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-abb79abd-7dc4-44f5-a0e0-0980c733b3fb req-ed045a1f-1f26-4c23-9465-c2160feac823 tempest-TestShelveInstance-2098619281 None] Terminate volume connection completed successfully. Jul 21 19:11:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-abb79abd-7dc4-44f5-a0e0-0980c733b3fb req-ed045a1f-1f26-4c23-9465-c2160feac823 tempest-TestShelveInstance-2098619281 None] Deleting attachment ca54f968-2e48-4c6e-bf0e-78cccd2c33eb. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:11:17 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.591s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:17 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:17 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] Deleted volume successfully. Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-38227977-518b-471f-9f43-b16ea79e1291 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-5d062b82-2419-4e6e-937f-e0566b3f80de-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Flow 'volume_create_manager' (70aac048-6697-4452-967d-b3ad550b1bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535a55b9-3f01-4c7f-b12b-1a72f3c6f486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535a55b9-3f01-4c7f-b12b-1a72f3c6f486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1809443323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467a5b51-b2cb-4e72-b899-07dd80ef3171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bffa966f5894d8b89cc0689d34d7f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:18Z,use_quota=True,user_id='652cf16568e54156bce558e9e3635244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217bfb8e-6725-485d-a8ae-9e1fc6032516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217bfb8e-6725-485d-a8ae-9e1fc6032516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15d17f2-b52c-4abf-b66b-a062c2e02afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15d17f2-b52c-4abf-b66b-a062c2e02afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '467a5b51-b2cb-4e72-b899-07dd80ef3171', 'volume_name': 'volume-467a5b51-b2cb-4e72-b899-07dd80ef3171', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974d3a40-2bb5-4528-9ae8-2cba5badbc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974d3a40-2bb5-4528-9ae8-2cba5badbc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de4203c-e282-4330-a8c3-88127c580758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:18 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Volume 467a5b51-b2cb-4e72-b899-07dd80ef3171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-467a5b51-b2cb-4e72-b899-07dd80ef3171', 'volume_size': 1} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1809443323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467a5b51-b2cb-4e72-b899-07dd80ef3171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bffa966f5894d8b89cc0689d34d7f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:18Z,use_quota=True,user_id='652cf16568e54156bce558e9e3635244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Creating volume 467a5b51-b2cb-4e72-b899-07dd80ef3171 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:18 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-467a5b51-b2cb-4e72-b899-07dd80ef3171 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:18 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-467a5b51-b2cb-4e72-b899-07dd80ef3171 1073741824 Jul 21 19:11:18 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:18 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-467a5b51-b2cb-4e72-b899-07dd80ef3171 1073741824" returned: 0 in 0.561s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-467a5b51-b2cb-4e72-b899-07dd80ef3171 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:19 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-467a5b51-b2cb-4e72-b899-07dd80ef3171 Jul 21 19:11:19 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:19 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-467a5b51-b2cb-4e72-b899-07dd80ef3171" returned: 0 in 0.325s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:19 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de4203c-e282-4330-a8c3-88127c580758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-467a5b51-b2cb-4e72-b899-07dd80ef3171', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b17d34c-6fe9-4081-9d29-20e55100759f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:19 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Volume volume-467a5b51-b2cb-4e72-b899-07dd80ef3171 (467a5b51-b2cb-4e72-b899-07dd80ef3171): created successfully Jul 21 19:11:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b17d34c-6fe9-4081-9d29-20e55100759f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Flow 'volume_create_manager' (70aac048-6697-4452-967d-b3ad550b1bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:19 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-6aa7e05f-7e90-449c-bee9-040e46ba0a8e tempest-VolumesActionsTest-913167815 None] Created volume successfully. Jul 21 19:11:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] Acquiring lock "cinder-467a5b51-b2cb-4e72-b899-07dd80ef3171-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-467a5b51-b2cb-4e72-b899-07dd80ef3171-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] Acquiring lock "cinder-quobyte-467a5b51-b2cb-4e72-b899-07dd80ef3171" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-quobyte-467a5b51-b2cb-4e72-b899-07dd80ef3171" acquired by "delete_volume" :: waited 0.028s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:20 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8d8c6e-1799-4b61-aca1-9e771a4c7911]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-467a5b51-b2cb-4e72-b899-07dd80ef3171 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:20 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-467a5b51-b2cb-4e72-b899-07dd80ef3171 Jul 21 19:11:20 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:21 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-467a5b51-b2cb-4e72-b899-07dd80ef3171" returned: 0 in 0.582s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-467a5b51-b2cb-4e72-b899-07dd80ef3171 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:21 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-467a5b51-b2cb-4e72-b899-07dd80ef3171 Jul 21 19:11:21 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:21 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-467a5b51-b2cb-4e72-b899-07dd80ef3171" returned: 0 in 0.298s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-quobyte-467a5b51-b2cb-4e72-b899-07dd80ef3171" released by "delete_volume" :: held 0.951s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-3a5743f3-eec1-4f72-96f2-983cca2037e7 req-2244abc6-6fcf-4c61-96a1-4d43ed395700 tempest-TestShelveInstance-2098619281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-3a5743f3-eec1-4f72-96f2-983cca2037e7 req-2244abc6-6fcf-4c61-96a1-4d43ed395700 tempest-TestShelveInstance-2098619281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-3a5743f3-eec1-4f72-96f2-983cca2037e7 req-2244abc6-6fcf-4c61-96a1-4d43ed395700 tempest-TestShelveInstance-2098619281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:21 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] Created reservations ['d2df7833-c752-48d5-8a05-ba0d21ec5b5e', '391f0740-4af4-4771-a3cc-92cbba74ab6d', 'cf529ac2-2293-4c57-a8cc-51c2161bf8d8', 'b095b93b-7f01-4426-a53f-93e1700b13ec'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-3a5743f3-eec1-4f72-96f2-983cca2037e7 req-2244abc6-6fcf-4c61-96a1-4d43ed395700 tempest-TestShelveInstance-2098619281 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-9dea1cbd-981f-40a4-a780-4a7d639e15db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e63ca6a8-bca5-4f20-82b6-cade8022742b', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:11:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:21 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:11:21 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:21 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-3a5743f3-eec1-4f72-96f2-983cca2037e7 req-2244abc6-6fcf-4c61-96a1-4d43ed395700 tempest-TestShelveInstance-2098619281 None] attachment_update completed successfully. Jul 21 19:11:22 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.330s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:22 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:22 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] Deleted volume successfully. Jul 21 19:11:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-81119b91-b421-43d9-a1dc-d096af7edce1 tempest-VolumesActionsTest-1704893228 None] Lock "cinder-467a5b51-b2cb-4e72-b899-07dd80ef3171-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Flow 'volume_create_manager' (fcee8a6a-217c-48c8-befc-74da53ac4284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecbec3d5-efbc-4715-b42b-0493e4bafd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecbec3d5-efbc-4715-b42b-0493e4bafd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-750153791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e42dea2-87b0-4c36-9548-b63f003b2d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bffa966f5894d8b89cc0689d34d7f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:23Z,use_quota=True,user_id='652cf16568e54156bce558e9e3635244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea69a57d-8c09-4235-a8b7-24f75a997914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea69a57d-8c09-4235-a8b7-24f75a997914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7a6799-713d-4f87-9fbc-b748b0952cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7a6799-713d-4f87-9fbc-b748b0952cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e42dea2-87b0-4c36-9548-b63f003b2d90', 'volume_name': 'volume-7e42dea2-87b0-4c36-9548-b63f003b2d90', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f5cb19-ca9f-450b-8c7f-84de48e0dabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f5cb19-ca9f-450b-8c7f-84de48e0dabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8580e0d4-2c7e-452e-b20b-f4aab51026c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:23 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Volume 7e42dea2-87b0-4c36-9548-b63f003b2d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e42dea2-87b0-4c36-9548-b63f003b2d90', 'volume_size': 1} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-750153791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e42dea2-87b0-4c36-9548-b63f003b2d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bffa966f5894d8b89cc0689d34d7f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:23Z,use_quota=True,user_id='652cf16568e54156bce558e9e3635244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Creating volume 7e42dea2-87b0-4c36-9548-b63f003b2d90 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:23 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:11:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e42dea2-87b0-4c36-9548-b63f003b2d90 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:23 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e42dea2-87b0-4c36-9548-b63f003b2d90 1073741824 Jul 21 19:11:23 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:24 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e42dea2-87b0-4c36-9548-b63f003b2d90 1073741824" returned: 0 in 0.645s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e42dea2-87b0-4c36-9548-b63f003b2d90 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:24 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e42dea2-87b0-4c36-9548-b63f003b2d90 Jul 21 19:11:24 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:24 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e42dea2-87b0-4c36-9548-b63f003b2d90" returned: 0 in 0.306s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8580e0d4-2c7e-452e-b20b-f4aab51026c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e42dea2-87b0-4c36-9548-b63f003b2d90', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a034fcaa-dad4-47d7-aad5-346838ad6de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:24 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Volume volume-7e42dea2-87b0-4c36-9548-b63f003b2d90 (7e42dea2-87b0-4c36-9548-b63f003b2d90): created successfully Jul 21 19:11:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a034fcaa-dad4-47d7-aad5-346838ad6de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Flow 'volume_create_manager' (fcee8a6a-217c-48c8-befc-74da53ac4284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:24 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-9675951c-6e3e-4ca7-8e0a-26a473f4ebe2 tempest-VolumesActionsTest-913167815 None] Created volume successfully. Jul 21 19:11:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] Acquiring lock "cinder-8b37175d-8830-4bdb-8555-13a193afd935-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] Lock "cinder-8b37175d-8830-4bdb-8555-13a193afd935-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] Acquiring lock "cinder-quobyte-8b37175d-8830-4bdb-8555-13a193afd935" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] Lock "cinder-quobyte-8b37175d-8830-4bdb-8555-13a193afd935" acquired by "delete_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:25 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[0115ff9d-1728-4081-a999-3d6a76c5c061]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8b37175d-8830-4bdb-8555-13a193afd935 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:26 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8b37175d-8830-4bdb-8555-13a193afd935 Jul 21 19:11:26 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:26 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8b37175d-8830-4bdb-8555-13a193afd935" returned: 0 in 0.567s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8b37175d-8830-4bdb-8555-13a193afd935 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:26 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8b37175d-8830-4bdb-8555-13a193afd935 Jul 21 19:11:26 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:26 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] Acquiring lock "cinder-7e42dea2-87b0-4c36-9548-b63f003b2d90-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-8b37175d-8830-4bdb-8555-13a193afd935" returned: 0 in 0.319s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] Lock "cinder-quobyte-8b37175d-8830-4bdb-8555-13a193afd935" released by "delete_volume" :: held 0.961s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] Lock "cinder-7e42dea2-87b0-4c36-9548-b63f003b2d90-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] Acquiring lock "cinder-quobyte-7e42dea2-87b0-4c36-9548-b63f003b2d90" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] Lock "cinder-quobyte-7e42dea2-87b0-4c36-9548-b63f003b2d90" acquired by "delete_volume" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:27 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] Created reservations ['fa4ec5f1-6c1b-43bd-825b-628c66042bfd', 'bac9e672-d6e8-4de8-b204-7dee892355bb', '564dcd1a-278b-476f-98ee-bd33d5e92f5a', 'e972da57-10b5-46af-9f95-ee1939e976fc'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:27 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[13067002-b000-4151-88ad-fcc15d8da47c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e42dea2-87b0-4c36-9548-b63f003b2d90 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:27 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e42dea2-87b0-4c36-9548-b63f003b2d90 Jul 21 19:11:27 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:27 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:11:27 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:27 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e42dea2-87b0-4c36-9548-b63f003b2d90" returned: 0 in 0.556s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e42dea2-87b0-4c36-9548-b63f003b2d90 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:27 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e42dea2-87b0-4c36-9548-b63f003b2d90 Jul 21 19:11:27 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:27 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.464s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:27 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:27 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] Deleted volume successfully. Jul 21 19:11:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-be61ce5b-2f94-4baf-ae94-515749073d5b tempest-VolumesNegativeTest-1992664903 None] Lock "cinder-8b37175d-8830-4bdb-8555-13a193afd935-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:27 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e42dea2-87b0-4c36-9548-b63f003b2d90" returned: 0 in 0.351s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] Lock "cinder-quobyte-7e42dea2-87b0-4c36-9548-b63f003b2d90" released by "delete_volume" :: held 0.973s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:28 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] Created reservations ['5b530ecd-fbd6-45bc-bd8e-a9de57310c13', '539734c0-ce18-4ab4-861f-5cfc3405f17b', 'fada4e39-fff0-440e-87f9-59fc986b3e96', 'dce384ba-1c62-4558-abe1-7db2c961c938'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:28 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:11:28 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:28 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.325s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:28 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:28 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] Deleted volume successfully. Jul 21 19:11:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0656f3e9-1fd0-444e-97ea-cdf2a67dd3fb tempest-VolumesActionsTest-913167815 None] Lock "cinder-7e42dea2-87b0-4c36-9548-b63f003b2d90-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:38 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=90,cinder:SELECT=63,cinder:INSERT=19,cinder:DELETE=5 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:11:38 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=44,cinder:SELECT=43,cinder:DELETE=6,cinder:INSERT=10 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Flow 'volume_create_manager' (0fc57cb9-2672-4f19-b057-9c03c5f69e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3e628f-3ffd-4b74-8326-44852521c328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3e628f-3ffd-4b74-8326-44852521c328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1658866004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf05692c-dee5-4553-947e-f632308f2c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54dd55b9f0404578bf15efd27600beca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:45Z,use_quota=True,user_id='4ba0693f8d7d4e6bbb82540cbf9ee9fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ee2f3f-e17f-4116-aeb1-a8bb46889c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ee2f3f-e17f-4116-aeb1-a8bb46889c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690ddf1f-0709-4ffe-8c13-dc4f0d3ea646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690ddf1f-0709-4ffe-8c13-dc4f0d3ea646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf05692c-dee5-4553-947e-f632308f2c30', 'volume_name': 'volume-cf05692c-dee5-4553-947e-f632308f2c30', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003dd73b-a0af-4ab2-851e-32265c0f5b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003dd73b-a0af-4ab2-851e-32265c0f5b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a13ac0c-a075-4109-ba13-cd540f36b0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:45 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Volume cf05692c-dee5-4553-947e-f632308f2c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf05692c-dee5-4553-947e-f632308f2c30', 'volume_size': 1} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1658866004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf05692c-dee5-4553-947e-f632308f2c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54dd55b9f0404578bf15efd27600beca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:45Z,use_quota=True,user_id='4ba0693f8d7d4e6bbb82540cbf9ee9fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Creating volume cf05692c-dee5-4553-947e-f632308f2c30 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:45 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf05692c-dee5-4553-947e-f632308f2c30 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:45 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf05692c-dee5-4553-947e-f632308f2c30 1073741824 Jul 21 19:11:45 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:45 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Flow 'volume_create_manager' (d9cda5c9-269c-4bf7-9a07-cef11ebabccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bfb02b-f20c-42f8-ad32-59265c014b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf05692c-dee5-4553-947e-f632308f2c30 1073741824" returned: 0 in 0.500s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bfb02b-f20c-42f8-ad32-59265c014b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2084845041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e31e13-b3e2-42a5-82a1-25f1c0a26261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52fc07f89d64b8982c14b7f9f33bdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:46Z,use_quota=True,user_id='097a842e272d4a93ab2974ae8feb2f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840241a2-30a6-4b32-9048-2f5296b43ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840241a2-30a6-4b32-9048-2f5296b43ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823c73c3-0f3a-4387-9804-eab84f63e862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823c73c3-0f3a-4387-9804-eab84f63e862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8e31e13-b3e2-42a5-82a1-25f1c0a26261', 'volume_name': 'volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356e44c5-5cce-4eef-98b6-f89ad6cdb466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356e44c5-5cce-4eef-98b6-f89ad6cdb466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99d41ad-b093-4be5-b5e5-d25658cbda6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:45 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Volume e8e31e13-b3e2-42a5-82a1-25f1c0a26261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261', 'volume_size': 1} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf05692c-dee5-4553-947e-f632308f2c30 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:45 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf05692c-dee5-4553-947e-f632308f2c30 Jul 21 19:11:45 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:46 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf05692c-dee5-4553-947e-f632308f2c30" returned: 0 in 0.281s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.310s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2084845041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e31e13-b3e2-42a5-82a1-25f1c0a26261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52fc07f89d64b8982c14b7f9f33bdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:46Z,use_quota=True,user_id='097a842e272d4a93ab2974ae8feb2f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Creating volume e8e31e13-b3e2-42a5-82a1-25f1c0a26261 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:46 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a13ac0c-a075-4109-ba13-cd540f36b0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf05692c-dee5-4553-947e-f632308f2c30', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:46 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261 1073741824 Jul 21 19:11:46 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe982d4-ee76-4583-bfa3-1cfd91f09e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:46 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Volume volume-cf05692c-dee5-4553-947e-f632308f2c30 (cf05692c-dee5-4553-947e-f632308f2c30): created successfully Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe982d4-ee76-4583-bfa3-1cfd91f09e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Flow 'volume_create_manager' (0fc57cb9-2672-4f19-b057-9c03c5f69e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:46 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-637b5dcc-8c87-43d8-9975-9212a0d2aa35 tempest-VolumesListAdminTestJSON-251401815 None] Created volume successfully. Jul 21 19:11:46 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261 1073741824" returned: 0 in 0.444s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:46 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261 Jul 21 19:11:46 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:46 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261" returned: 0 in 0.239s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99d41ad-b093-4be5-b5e5-d25658cbda6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3379215-d962-4be4-8b13-4fee1b5fcab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:46 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Volume volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261 (e8e31e13-b3e2-42a5-82a1-25f1c0a26261): created successfully Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3379215-d962-4be4-8b13-4fee1b5fcab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Flow 'volume_create_manager' (d9cda5c9-269c-4bf7-9a07-cef11ebabccc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:46 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-12340eb2-0c70-4b44-8604-4511fcbcb208 tempest-VolumesSnapshotTestJSON-493745841 None] Created volume successfully. Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Flow 'volume_create_manager' (59baf5b8-e951-4bf2-8b9a-5396ea984d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f0cde9-b7b7-4479-ad02-ac14610bdfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f0cde9-b7b7-4479-ad02-ac14610bdfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1784475391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47fc1c7d-96ac-47b4-8178-7031833ecd7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54dd55b9f0404578bf15efd27600beca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:48Z,use_quota=True,user_id='4ba0693f8d7d4e6bbb82540cbf9ee9fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38c933b-8c8d-47ae-8d56-b027500aee1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38c933b-8c8d-47ae-8d56-b027500aee1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afca87ee-9263-4cd8-b113-6558b8f174f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afca87ee-9263-4cd8-b113-6558b8f174f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47fc1c7d-96ac-47b4-8178-7031833ecd7a', 'volume_name': 'volume-47fc1c7d-96ac-47b4-8178-7031833ecd7a', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879dd89f-2934-45ef-996b-3a895eb129b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879dd89f-2934-45ef-996b-3a895eb129b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1762ca17-6c4a-4f03-b4c5-d9a46e212e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:47 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Volume 47fc1c7d-96ac-47b4-8178-7031833ecd7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47fc1c7d-96ac-47b4-8178-7031833ecd7a', 'volume_size': 1} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1784475391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47fc1c7d-96ac-47b4-8178-7031833ecd7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54dd55b9f0404578bf15efd27600beca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:48Z,use_quota=True,user_id='4ba0693f8d7d4e6bbb82540cbf9ee9fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Creating volume 47fc1c7d-96ac-47b4-8178-7031833ecd7a {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:47 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:11:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-47fc1c7d-96ac-47b4-8178-7031833ecd7a 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:47 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-47fc1c7d-96ac-47b4-8178-7031833ecd7a 1073741824 Jul 21 19:11:47 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:48 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-47fc1c7d-96ac-47b4-8178-7031833ecd7a 1073741824" returned: 0 in 0.462s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-47fc1c7d-96ac-47b4-8178-7031833ecd7a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:48 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-47fc1c7d-96ac-47b4-8178-7031833ecd7a Jul 21 19:11:48 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:48 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-47fc1c7d-96ac-47b4-8178-7031833ecd7a" returned: 0 in 0.258s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.507s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] Creating offline snapshot 45e25cb9-8f9d-44f4-ba93-93fe05c85bf8 of volume e8e31e13-b3e2-42a5-82a1-25f1c0a26261 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:11:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1762ca17-6c4a-4f03-b4c5-d9a46e212e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47fc1c7d-96ac-47b4-8178-7031833ecd7a', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b79a27-8fc7-4a31-9998-2678d9d94444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:48 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[8735e3ad-8910-468f-bd83-fb42543461f7]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:48 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Volume volume-47fc1c7d-96ac-47b4-8178-7031833ecd7a (47fc1c7d-96ac-47b4-8178-7031833ecd7a): created successfully Jul 21 19:11:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b79a27-8fc7-4a31-9998-2678d9d94444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Flow 'volume_create_manager' (59baf5b8-e951-4bf2-8b9a-5396ea984d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:48 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-b0480d37-c0c7-4030-bea3-b034a1a8e469 tempest-VolumesListAdminTestJSON-251401815 None] Created volume successfully. Jul 21 19:11:48 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261 Jul 21 19:11:48 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:48 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261" returned: 0 in 0.368s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:48 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8 1G Jul 21 19:11:48 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:49 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8 1G" returned: 0 in 0.387s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:49 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8 Jul 21 19:11:49 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:49 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8" returned: 0 in 0.273s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:49 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8 is being set with open permissions: ugo+rw Jul 21 19:11:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:49 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8 Jul 21 19:11:49 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:49 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8" returned: 0 in 0.275s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:49 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.info Jul 21 19:11:49 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:50 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.info" returned: 0 in 0.353s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:50 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.info is being set with open permissions: ugo+rw Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:50 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.info Jul 21 19:11:50 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Flow 'volume_create_manager' (f907adef-0a44-4f07-9d0f-1056d3f5e067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f081ca-b3b3-44fe-8345-32d4e67933b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f081ca-b3b3-44fe-8345-32d4e67933b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-211045295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb668d0e-9df8-49a3-b152-59693929f2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54dd55b9f0404578bf15efd27600beca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:50Z,use_quota=True,user_id='4ba0693f8d7d4e6bbb82540cbf9ee9fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3097b0a8-08bf-4e47-b6a9-c50af6b056eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3097b0a8-08bf-4e47-b6a9-c50af6b056eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5d5028-f9e1-4b89-839d-0ca8df770368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5d5028-f9e1-4b89-839d-0ca8df770368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb668d0e-9df8-49a3-b152-59693929f2dd', 'volume_name': 'volume-eb668d0e-9df8-49a3-b152-59693929f2dd', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8951ee32-3ca6-41f5-9d92-0594cde99381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8951ee32-3ca6-41f5-9d92-0594cde99381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd339aa-86b6-41c9-b3d2-7046e7e00221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:50 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Volume eb668d0e-9df8-49a3-b152-59693929f2dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb668d0e-9df8-49a3-b152-59693929f2dd', 'volume_size': 1} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:50 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.info" returned: 0 in 0.381s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-211045295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb668d0e-9df8-49a3-b152-59693929f2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54dd55b9f0404578bf15efd27600beca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:50Z,use_quota=True,user_id='4ba0693f8d7d4e6bbb82540cbf9ee9fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Creating volume eb668d0e-9df8-49a3-b152-59693929f2dd {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:50 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:11:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb668d0e-9df8-49a3-b152-59693929f2dd 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:50 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb668d0e-9df8-49a3-b152-59693929f2dd 1073741824 Jul 21 19:11:50 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:50 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-154a335a-50df-4a48-b31b-407b238c8948 tempest-VolumesSnapshotTestJSON-493745841 None] Create snapshot completed successfully Jul 21 19:11:51 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb668d0e-9df8-49a3-b152-59693929f2dd 1073741824" returned: 0 in 0.556s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb668d0e-9df8-49a3-b152-59693929f2dd {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:51 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb668d0e-9df8-49a3-b152-59693929f2dd Jul 21 19:11:51 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-45e25cb9-8f9d-44f4-ba93-93fe05c85bf8-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-45e25cb9-8f9d-44f4-ba93-93fe05c85bf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-quobyte-e8e31e13-b3e2-42a5-82a1-25f1c0a26261" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-e8e31e13-b3e2-42a5-82a1-25f1c0a26261" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-quobyte-45e25cb9-8f9d-44f4-ba93-93fe05c85bf8" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-45e25cb9-8f9d-44f4-ba93-93fe05c85bf8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] Deleting offline snapshot 45e25cb9-8f9d-44f4-ba93-93fe05c85bf8 of volume e8e31e13-b3e2-42a5-82a1-25f1c0a26261 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] snapshot_file for this snap is: volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[7731e30d-011d-4868-96c2-97867f355d37]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:51 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb668d0e-9df8-49a3-b152-59693929f2dd" returned: 0 in 0.340s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd339aa-86b6-41c9-b3d2-7046e7e00221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb668d0e-9df8-49a3-b152-59693929f2dd', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422f15c5-c6ca-42c8-b9d0-fcb2ee0f15bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:51 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8 Jul 21 19:11:51 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:51 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Volume volume-eb668d0e-9df8-49a3-b152-59693929f2dd (eb668d0e-9df8-49a3-b152-59693929f2dd): created successfully Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422f15c5-c6ca-42c8-b9d0-fcb2ee0f15bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Flow 'volume_create_manager' (f907adef-0a44-4f07-9d0f-1056d3f5e067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:51 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-563d65d2-f48e-4297-bb65-9243663bf8f1 tempest-VolumesListAdminTestJSON-251401815 None] Created volume successfully. Jul 21 19:11:52 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8" returned: 0 in 0.433s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:11:52 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3384c3-a700-4553-b919-2680ddb3dfb5]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:52 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261 Jul 21 19:11:52 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:52 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261" returned: 0 in 0.382s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:52 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8 Jul 21 19:11:52 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:52 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8" returned: 0 in 0.450s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:52 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8 Jul 21 19:11:52 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:53 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261.45e25cb9-8f9d-44f4-ba93-93fe05c85bf8" returned: 0 in 0.304s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-45e25cb9-8f9d-44f4-ba93-93fe05c85bf8" released by "_delete_snapshot" :: held 1.682s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-e8e31e13-b3e2-42a5-82a1-25f1c0a26261" released by "delete_snapshot" :: held 1.715s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Flow 'volume_create_manager' (4ebae71d-23d2-4a54-ae40-de9f94090935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9fba84-66a2-4399-831e-53391cacdae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9fba84-66a2-4399-831e-53391cacdae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d8e58a-fe0c-46f7-95cf-9e84093e08a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f1a6cb8af744e49da61db6bc590609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:53Z,use_quota=True,user_id='9c8b4a5035de45afb1f60bca3b7d6888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80452ed-0bf7-4cbe-b9fd-dfffcff51b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80452ed-0bf7-4cbe-b9fd-dfffcff51b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e94a0d-a72b-4c81-a742-f07c77759195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e94a0d-a72b-4c81-a742-f07c77759195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26d8e58a-fe0c-46f7-95cf-9e84093e08a0', 'volume_name': 'volume-26d8e58a-fe0c-46f7-95cf-9e84093e08a0', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b65dab-3924-4240-ba3d-65dd839423c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b65dab-3924-4240-ba3d-65dd839423c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b65aea-fe5e-4f2d-9279-65cbd4dea73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:53 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Volume 26d8e58a-fe0c-46f7-95cf-9e84093e08a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26d8e58a-fe0c-46f7-95cf-9e84093e08a0', 'volume_size': 1} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d8e58a-fe0c-46f7-95cf-9e84093e08a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f1a6cb8af744e49da61db6bc590609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:53Z,use_quota=True,user_id='9c8b4a5035de45afb1f60bca3b7d6888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Creating volume 26d8e58a-fe0c-46f7-95cf-9e84093e08a0 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:53 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-26d8e58a-fe0c-46f7-95cf-9e84093e08a0 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:53 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-26d8e58a-fe0c-46f7-95cf-9e84093e08a0 1073741824 Jul 21 19:11:53 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] Created reservations ['1f665795-5dd9-47db-9760-b4274a4e885d', '238d56fc-7209-4c4d-8ed8-7123dcf0d025', '82d47d71-36ff-43f6-aa50-1a88c8b4336e', '20af9dd1-9840-4992-9906-62a3f061e46b'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:53 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] Delete snapshot completed successfully. Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ae7653d4-b974-43a6-a3dd-f192c6d75cf5 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-45e25cb9-8f9d-44f4-ba93-93fe05c85bf8-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:53 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-26d8e58a-fe0c-46f7-95cf-9e84093e08a0 1073741824" returned: 0 in 0.467s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-26d8e58a-fe0c-46f7-95cf-9e84093e08a0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:53 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-26d8e58a-fe0c-46f7-95cf-9e84093e08a0 Jul 21 19:11:53 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:54 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-26d8e58a-fe0c-46f7-95cf-9e84093e08a0" returned: 0 in 0.281s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b65aea-fe5e-4f2d-9279-65cbd4dea73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26d8e58a-fe0c-46f7-95cf-9e84093e08a0', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80f8834-f8d7-4091-8ebd-b3a34e163239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Flow 'volume_create_manager' (d921d79f-f175-40f0-9942-cc668c7711f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290dfb73-12f8-4b49-807e-a557e17f3a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290dfb73-12f8-4b49-807e-a557e17f3a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-542319185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad2238d-e2b9-456a-a87a-40f870f1769a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52fc07f89d64b8982c14b7f9f33bdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:54Z,use_quota=True,user_id='097a842e272d4a93ab2974ae8feb2f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afc5a30-5ab7-467c-8190-e387d2bd93e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afc5a30-5ab7-467c-8190-e387d2bd93e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14705e96-1535-4e25-83fc-e505d3d1dbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14705e96-1535-4e25-83fc-e505d3d1dbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fad2238d-e2b9-456a-a87a-40f870f1769a', 'volume_name': 'volume-fad2238d-e2b9-456a-a87a-40f870f1769a', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072d16db-c7f4-4bd6-8520-bd1262e7ea2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072d16db-c7f4-4bd6-8520-bd1262e7ea2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ded022-a671-422b-b1e1-a4905a8ca5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:54 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Volume fad2238d-e2b9-456a-a87a-40f870f1769a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fad2238d-e2b9-456a-a87a-40f870f1769a', 'volume_size': 1} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-542319185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad2238d-e2b9-456a-a87a-40f870f1769a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52fc07f89d64b8982c14b7f9f33bdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:54Z,use_quota=True,user_id='097a842e272d4a93ab2974ae8feb2f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Creating volume fad2238d-e2b9-456a-a87a-40f870f1769a {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:54 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:54 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Volume volume-26d8e58a-fe0c-46f7-95cf-9e84093e08a0 (26d8e58a-fe0c-46f7-95cf-9e84093e08a0): created successfully Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80f8834-f8d7-4091-8ebd-b3a34e163239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Flow 'volume_create_manager' (4ebae71d-23d2-4a54-ae40-de9f94090935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:54 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a 1073741824 Jul 21 19:11:54 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:54 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-ed7887bb-9809-4ebc-aaed-433488048e38 tempest-VolumesListAdminTestJSON-1290241634 None] Created volume successfully. Jul 21 19:11:54 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a 1073741824" returned: 0 in 0.440s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:54 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a Jul 21 19:11:54 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:55 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a" returned: 0 in 0.251s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ded022-a671-422b-b1e1-a4905a8ca5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fad2238d-e2b9-456a-a87a-40f870f1769a', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923759b6-dd24-46d5-ad31-cc05107dadbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:55 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Volume volume-fad2238d-e2b9-456a-a87a-40f870f1769a (fad2238d-e2b9-456a-a87a-40f870f1769a): created successfully Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923759b6-dd24-46d5-ad31-cc05107dadbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Flow 'volume_create_manager' (d921d79f-f175-40f0-9942-cc668c7711f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:55 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-724283d7-1fdb-414e-9a27-b539607aea46 tempest-VolumesSnapshotTestJSON-493745841 None] Created volume successfully. Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] Creating offline snapshot 3897ac0f-0daa-4495-a002-8c2590ccd85c of volume fad2238d-e2b9-456a-a87a-40f870f1769a {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f0b082-67a4-4d3e-bc89-d1c4fd27676c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] Acquiring lock "cinder-26d8e58a-fe0c-46f7-95cf-9e84093e08a0-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] Lock "cinder-26d8e58a-fe0c-46f7-95cf-9e84093e08a0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:55 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a Jul 21 19:11:55 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] Acquiring lock "cinder-quobyte-26d8e58a-fe0c-46f7-95cf-9e84093e08a0" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] Lock "cinder-quobyte-26d8e58a-fe0c-46f7-95cf-9e84093e08a0" acquired by "delete_volume" :: waited 0.019s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ff99e4-5e61-4bdd-ae5c-cb380721e936]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-26d8e58a-fe0c-46f7-95cf-9e84093e08a0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] Acquiring lock "cinder-eb668d0e-9df8-49a3-b152-59693929f2dd-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] Lock "cinder-eb668d0e-9df8-49a3-b152-59693929f2dd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] Acquiring lock "cinder-quobyte-eb668d0e-9df8-49a3-b152-59693929f2dd" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] Lock "cinder-quobyte-eb668d0e-9df8-49a3-b152-59693929f2dd" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:55 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-26d8e58a-fe0c-46f7-95cf-9e84093e08a0 Jul 21 19:11:55 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1645b3-e722-4a29-9372-f7d2eba3b40d]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb668d0e-9df8-49a3-b152-59693929f2dd {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:55 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a" returned: 0 in 0.426s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:55 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c 1G Jul 21 19:11:55 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:55 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb668d0e-9df8-49a3-b152-59693929f2dd Jul 21 19:11:55 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:56 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-26d8e58a-fe0c-46f7-95cf-9e84093e08a0" returned: 0 in 0.429s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-26d8e58a-fe0c-46f7-95cf-9e84093e08a0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:56 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-26d8e58a-fe0c-46f7-95cf-9e84093e08a0 Jul 21 19:11:56 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:56 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb668d0e-9df8-49a3-b152-59693929f2dd" returned: 0 in 0.372s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb668d0e-9df8-49a3-b152-59693929f2dd {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:56 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb668d0e-9df8-49a3-b152-59693929f2dd Jul 21 19:11:56 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:56 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c 1G" returned: 0 in 0.451s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fad2238d-e2b9-456a-a87a-40f870f1769a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:56 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-26d8e58a-fe0c-46f7-95cf-9e84093e08a0" returned: 0 in 0.270s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:56 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fad2238d-e2b9-456a-a87a-40f870f1769a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] Lock "cinder-quobyte-26d8e58a-fe0c-46f7-95cf-9e84093e08a0" released by "delete_volume" :: held 0.747s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:56 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] Created reservations ['6ad84ced-c923-4a17-8723-30032843ebc7', '171e27d1-a190-4d7d-b1af-b767c32d3ffe', 'd5f7d6b6-735f-4044-b81f-5a354745a1f3', 'e29613fa-431b-435a-8686-eaa0d111148b'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:56 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb668d0e-9df8-49a3-b152-59693929f2dd" returned: 0 in 0.296s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] Lock "cinder-quobyte-eb668d0e-9df8-49a3-b152-59693929f2dd" released by "delete_volume" :: held 0.718s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:56 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:11:56 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] Created reservations ['e6170136-e519-40a0-8081-d976f9955068', '060f3ce2-6c35-4efd-9423-5d8328921bb5', 'a191c82b-6575-42d9-808d-91f288559bf3', '39635cd3-716b-4710-aed1-4488148c7388'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:56 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fad2238d-e2b9-456a-a87a-40f870f1769a -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c" returned: 0 in 0.347s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:56 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c is being set with open permissions: ugo+rw Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:56 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:11:56 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:56 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c Jul 21 19:11:56 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:56 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.273s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:56 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] Deleted volume successfully. Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-49c1b9b7-0ba1-40b1-8f53-1aa1f7bad4d3 tempest-VolumesListAdminTestJSON-1290241634 None] Lock "cinder-26d8e58a-fe0c-46f7-95cf-9e84093e08a0-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:56 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:11:56 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:56 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.292s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:56 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] Acquiring lock "cinder-47fc1c7d-96ac-47b4-8178-7031833ecd7a-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:56 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] Deleted volume successfully. Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c" returned: 0 in 0.309s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] Lock "cinder-47fc1c7d-96ac-47b4-8178-7031833ecd7a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b8a9911d-5d47-4620-9062-ace18a509748 tempest-VolumesListAdminTestJSON-251401815 None] Lock "cinder-eb668d0e-9df8-49a3-b152-59693929f2dd-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:57 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.info Jul 21 19:11:57 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] Acquiring lock "cinder-quobyte-47fc1c7d-96ac-47b4-8178-7031833ecd7a" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] Lock "cinder-quobyte-47fc1c7d-96ac-47b4-8178-7031833ecd7a" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8aefdda-eb84-46c4-bfa2-10c7db5ccc81]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-47fc1c7d-96ac-47b4-8178-7031833ecd7a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:57 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.301s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:11:57 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-47fc1c7d-96ac-47b4-8178-7031833ecd7a Jul 21 19:11:57 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:57 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.info" returned: 0 in 0.272s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:57 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.info is being set with open permissions: ugo+rw Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:57 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.info Jul 21 19:11:57 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:57 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-47fc1c7d-96ac-47b4-8178-7031833ecd7a" returned: 0 in 0.384s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-47fc1c7d-96ac-47b4-8178-7031833ecd7a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:57 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-47fc1c7d-96ac-47b4-8178-7031833ecd7a Jul 21 19:11:57 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:57 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.info" returned: 0 in 0.294s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.230s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:57 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-5fc50312-820c-4dcd-a066-21b320337032 tempest-VolumesSnapshotTestJSON-493745841 None] Create snapshot completed successfully Jul 21 19:11:57 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-47fc1c7d-96ac-47b4-8178-7031833ecd7a" returned: 0 in 0.253s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] Lock "cinder-quobyte-47fc1c7d-96ac-47b4-8178-7031833ecd7a" released by "delete_volume" :: held 0.679s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] Created reservations ['bb601c8d-3686-42fc-8844-008e658789c7', 'c7d8c43e-7f5d-4481-a2f1-cd40c80404c4', '4f292ca9-1ccb-4d07-8a1a-455135a01442', '585d766f-7dec-4be0-bfbd-45d1052c0cc6'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:57 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:11:57 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:58 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.250s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:58 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:58 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] Deleted volume successfully. Jul 21 19:11:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a7a1f4a4-3a40-4e91-94d4-8de192252bb3 tempest-VolumesListAdminTestJSON-251401815 None] Lock "cinder-47fc1c7d-96ac-47b4-8178-7031833ecd7a-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] Acquiring lock "cinder-cf05692c-dee5-4553-947e-f632308f2c30-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] Lock "cinder-cf05692c-dee5-4553-947e-f632308f2c30-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] Acquiring lock "cinder-quobyte-cf05692c-dee5-4553-947e-f632308f2c30" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] Lock "cinder-quobyte-cf05692c-dee5-4553-947e-f632308f2c30" acquired by "delete_volume" :: waited 0.015s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:58 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[efeb0779-3233-43fc-ac8a-a41c07815faa]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf05692c-dee5-4553-947e-f632308f2c30 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:58 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf05692c-dee5-4553-947e-f632308f2c30 Jul 21 19:11:58 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:58 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf05692c-dee5-4553-947e-f632308f2c30" returned: 0 in 0.354s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf05692c-dee5-4553-947e-f632308f2c30 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:58 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf05692c-dee5-4553-947e-f632308f2c30 Jul 21 19:11:58 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:58 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf05692c-dee5-4553-947e-f632308f2c30" returned: 0 in 0.247s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] Lock "cinder-quobyte-cf05692c-dee5-4553-947e-f632308f2c30" released by "delete_volume" :: held 0.648s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:58 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] Created reservations ['b8ea4d34-bd21-40c7-8392-0373535c25bc', 'b018665e-d1e0-4b59-9618-2d7c3c73a9d1', '659f9778-3767-48bc-88f4-283426a071e2', '55af05a9-0491-4673-8d34-143938678e69'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:59 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:11:59 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Flow 'volume_create_manager' (d471cc55-2288-42ff-8c71-d9657b458b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a560b23-bb70-4fdf-85b6-960c602feef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a560b23-bb70-4fdf-85b6-960c602feef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-504164984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87676bfc-03c2-4fbe-93f5-7ee2031f1937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52fc07f89d64b8982c14b7f9f33bdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3897ac0f-0daa-4495-a002-8c2590ccd85c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:59Z,use_quota=True,user_id='097a842e272d4a93ab2974ae8feb2f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd14f80b-5a9e-45e5-bab2-cf96e6ba39e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd14f80b-5a9e-45e5-bab2-cf96e6ba39e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760cff6f-dc0a-4c08-86e6-a6cc79e979de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760cff6f-dc0a-4c08-86e6-a6cc79e979de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '87676bfc-03c2-4fbe-93f5-7ee2031f1937', 'volume_name': 'volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937', 'volume_size': 2, 'snapshot_id': '3897ac0f-0daa-4495-a002-8c2590ccd85c'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1053131a-54e5-4ee3-8f6b-31efab950eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1053131a-54e5-4ee3-8f6b-31efab950eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cb9471-df81-4d35-9bd8-151202aca881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:59 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Volume 87676bfc-03c2-4fbe-93f5-7ee2031f1937: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937', 'volume_size': 2, 'snapshot_id': '3897ac0f-0daa-4495-a002-8c2590ccd85c'} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-quobyte-3897ac0f-0daa-4495-a002-8c2590ccd85c-87676bfc-03c2-4fbe-93f5-7ee2031f1937" by "_create_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-3897ac0f-0daa-4495-a002-8c2590ccd85c-87676bfc-03c2-4fbe-93f5-7ee2031f1937" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Creating volume 87676bfc-03c2-4fbe-93f5-7ee2031f1937 from snapshot 3897ac0f-0daa-4495-a002-8c2590ccd85c {{(pid=87570) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-quobyte-87676bfc-03c2-4fbe-93f5-7ee2031f1937" by "_copy_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-87676bfc-03c2-4fbe-93f5-7ee2031f1937" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] snapshot: 3897ac0f-0daa-4495-a002-8c2590ccd85c, volume: 87676bfc-03c2-4fbe-93f5-7ee2031f1937, {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce8a613-398b-4488-9a2a-5f61c1733b60]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:59 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.271s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:59 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] Deleted volume successfully. Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0453b324-a07b-4187-9b6c-15fab47e19b8 tempest-VolumesListAdminTestJSON-251401815 None] Lock "cinder-cf05692c-dee5-4553-947e-f632308f2c30-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:59 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c Jul 21 19:11:59 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:59 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c" returned: 0 in 0.386s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fad2238d-e2b9-456a-a87a-40f870f1769a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Creating direct copy from snapshot {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33f1c2b-2298-4ffa-ad6b-a4a4b9437a5c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:59 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a Jul 21 19:11:59 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:00 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a" returned: 0 in 0.383s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:00 devstack cinder-volume[87570]: DEBUG cinder.utils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Path /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937 not found in is_blk_device check {{(pid=87570) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:12:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:00 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937 Jul 21 19:12:00 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:05 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937" returned: 0 in 5.009s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:05 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb59f3d7-0713-441f-8bff-3349bf493988]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:05 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a Jul 21 19:12:05 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:05 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a" returned: 0 in 0.570s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:05 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Image conversion details: src /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937 {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:12:05 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Converted 1024.00 MB image at 204.37 MB/s Jul 21 19:12:05 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937 is being set with open permissions: ugo+rw Jul 21 19:12:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:05 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937 Jul 21 19:12:05 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:06 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937" returned: 0 in 0.392s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-87676bfc-03c2-4fbe-93f5-7ee2031f1937" released by "_copy_volume_from_snapshot" :: held 6.852s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-3897ac0f-0daa-4495-a002-8c2590ccd85c-87676bfc-03c2-4fbe-93f5-7ee2031f1937" released by "_create_volume_from_snapshot" :: held 6.893s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.913s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cb9471-df81-4d35-9bd8-151202aca881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937', 'volume_size': 2, 'snapshot_id': '3897ac0f-0daa-4495-a002-8c2590ccd85c'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57467976-b267-43cb-a255-ed1ffd51038b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:06 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Volume volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937 (87676bfc-03c2-4fbe-93f5-7ee2031f1937): created successfully Jul 21 19:12:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57467976-b267-43cb-a255-ed1ffd51038b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Flow 'volume_create_manager' (d471cc55-2288-42ff-8c71-d9657b458b5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:06 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-6088a9dc-ca23-4626-817b-08d82a31897e tempest-VolumesSnapshotTestJSON-493745841 None] Created volume successfully. Jul 21 19:12:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-87676bfc-03c2-4fbe-93f5-7ee2031f1937-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-87676bfc-03c2-4fbe-93f5-7ee2031f1937-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-quobyte-87676bfc-03c2-4fbe-93f5-7ee2031f1937" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-87676bfc-03c2-4fbe-93f5-7ee2031f1937" acquired by "delete_volume" :: waited 0.015s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:07 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1916113-fb81-4c91-935f-0f11604de886]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:07 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937 Jul 21 19:12:07 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:07 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937" returned: 0 in 0.399s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:07 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937 Jul 21 19:12:07 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:07 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-87676bfc-03c2-4fbe-93f5-7ee2031f1937" returned: 0 in 0.388s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-87676bfc-03c2-4fbe-93f5-7ee2031f1937" released by "delete_volume" :: held 0.873s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:08 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-91ccdfcb-9047-4d59-9c31-8bad15a85fc9 tempest-TestShelveInstance-2098619281 None] Terminate volume connection completed successfully. Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-91ccdfcb-9047-4d59-9c31-8bad15a85fc9 tempest-TestShelveInstance-2098619281 None] Deleting attachment e63ca6a8-bca5-4f20-82b6-cade8022742b. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] Created reservations ['ffcf30e1-5815-4341-bb25-e4043f01fb8b', 'b72903f9-4848-4be0-b4e3-1dbd985bdd65', '19dbd6fe-8a26-437b-ab6b-a6136e74f34e', '8dc51d47-2d75-46f4-b8b9-a1447606b5fb'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:08 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:08 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] Acquiring lock "cinder-9dea1cbd-981f-40a4-a780-4a7d639e15db-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] Lock "cinder-9dea1cbd-981f-40a4-a780-4a7d639e15db-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] Acquiring lock "cinder-quobyte-9dea1cbd-981f-40a4-a780-4a7d639e15db" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-3897ac0f-0daa-4495-a002-8c2590ccd85c-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] Lock "cinder-quobyte-9dea1cbd-981f-40a4-a780-4a7d639e15db" acquired by "delete_volume" :: waited 0.067s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-3897ac0f-0daa-4495-a002-8c2590ccd85c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.088s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-quobyte-fad2238d-e2b9-456a-a87a-40f870f1769a" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b23de0-1448-47f4-850b-f803bffe1ba4]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-fad2238d-e2b9-456a-a87a-40f870f1769a" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-quobyte-3897ac0f-0daa-4495-a002-8c2590ccd85c" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-3897ac0f-0daa-4495-a002-8c2590ccd85c" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] Deleting offline snapshot 3897ac0f-0daa-4495-a002-8c2590ccd85c of volume fad2238d-e2b9-456a-a87a-40f870f1769a {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] snapshot_file for this snap is: volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c8ae9e-bfe0-43c0-af7d-11ec3729724f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:08 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.454s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:08 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] Deleted volume successfully. Jul 21 19:12:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-77a767c7-8d6d-4200-a612-6372778d4e89 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-87676bfc-03c2-4fbe-93f5-7ee2031f1937-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:08 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db Jul 21 19:12:08 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:08 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c Jul 21 19:12:08 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:09 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db" returned: 0 in 0.523s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:09 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db Jul 21 19:12:09 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:09 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c" returned: 0 in 0.551s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fad2238d-e2b9-456a-a87a-40f870f1769a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:12:09 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ace1564-d6a3-4151-bd85-156334979ab8]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:09 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9dea1cbd-981f-40a4-a780-4a7d639e15db" returned: 0 in 0.314s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] Lock "cinder-quobyte-9dea1cbd-981f-40a4-a780-4a7d639e15db" released by "delete_volume" :: held 0.936s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:09 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a Jul 21 19:12:09 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:09 devstack cinder-volume[87570]: DEBUG cinder.quota [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] Created reservations ['9a58dd9f-7efc-4257-9237-23e4cdfb430c', '5e934cc5-cc07-4bfa-8ecd-6f0384a42c46', '3473ffe9-0ddc-40d1-9822-0b5c2adcd7f0', 'c2af159b-53c0-4ed0-a3f5-8b88d66c769b'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:09 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:09 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:09 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a" returned: 0 in 0.566s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:09 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c Jul 21 19:12:09 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:10 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.403s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:10 devstack cinder-volume[87570]: DEBUG cinder.manager [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:10 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] Deleted volume successfully. Jul 21 19:12:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [req-53faf5f6-8bb1-462e-82f8-f393e39a53e5 req-e2831e84-33fe-46a2-a803-6237ffd6c309 tempest-TestShelveInstance-2098619281 None] Lock "cinder-9dea1cbd-981f-40a4-a780-4a7d639e15db-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:10 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c" returned: 0 in 0.442s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:10 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c Jul 21 19:12:10 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:10 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a.3897ac0f-0daa-4495-a002-8c2590ccd85c" returned: 0 in 0.286s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-3897ac0f-0daa-4495-a002-8c2590ccd85c" released by "_delete_snapshot" :: held 2.034s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-fad2238d-e2b9-456a-a87a-40f870f1769a" released by "delete_snapshot" :: held 2.090s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:10 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] Created reservations ['1b6cfdfb-a809-42d1-9ed0-2e5774ec8da4', '84f221ab-7de7-4f9e-975a-0591606ef4e0', '972fe5af-cf82-4240-b7b1-43cb294aa3c1', '0441074e-26ff-4337-8735-b7bf09973879'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:10 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] Delete snapshot completed successfully. Jul 21 19:12:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d23a09a8-a895-41ff-abf8-da0d2645a396 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-3897ac0f-0daa-4495-a002-8c2590ccd85c-delete_snapshot" released by "delete_snapshot" :: held 2.338s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-fad2238d-e2b9-456a-a87a-40f870f1769a-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-fad2238d-e2b9-456a-a87a-40f870f1769a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-quobyte-fad2238d-e2b9-456a-a87a-40f870f1769a" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-fad2238d-e2b9-456a-a87a-40f870f1769a" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:11 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2888a143-1556-44f3-9680-97a8e45d760c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:12 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a Jul 21 19:12:12 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Flow 'volume_create_manager' (b0e1e938-3a27-4672-ada3-ffa651573771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68edd48c-ec53-4c58-ac22-19ebbffbc87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68edd48c-ec53-4c58-ac22-19ebbffbc87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1995938145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daed8b51-6c39-41b5-860a-4292e60dadcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad62faa11b264f449ee54ff79d7f674f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:12Z,use_quota=True,user_id='54f1d9df3a6d4426be7f91acf5805e76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26728044-ec85-42a8-909c-ffc91f9d09ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26728044-ec85-42a8-909c-ffc91f9d09ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd918cbd-777c-4933-a685-a3a98db5c444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd918cbd-777c-4933-a685-a3a98db5c444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daed8b51-6c39-41b5-860a-4292e60dadcc', 'volume_name': 'volume-daed8b51-6c39-41b5-860a-4292e60dadcc', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f136d737-b858-49fb-b21e-672c91e4da44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f136d737-b858-49fb-b21e-672c91e4da44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ed5127-8747-4dfc-95f5-a89d1fcec092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:12 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Volume daed8b51-6c39-41b5-860a-4292e60dadcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daed8b51-6c39-41b5-860a-4292e60dadcc', 'volume_size': 1} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1995938145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daed8b51-6c39-41b5-860a-4292e60dadcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad62faa11b264f449ee54ff79d7f674f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:12Z,use_quota=True,user_id='54f1d9df3a6d4426be7f91acf5805e76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Creating volume daed8b51-6c39-41b5-860a-4292e60dadcc {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:12 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-daed8b51-6c39-41b5-860a-4292e60dadcc 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:12 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a" returned: 0 in 0.432s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:12 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-daed8b51-6c39-41b5-860a-4292e60dadcc 1073741824 Jul 21 19:12:12 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:12 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a Jul 21 19:12:12 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:12 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-fad2238d-e2b9-456a-a87a-40f870f1769a" returned: 0 in 0.279s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-fad2238d-e2b9-456a-a87a-40f870f1769a" released by "delete_volume" :: held 0.792s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] Created reservations ['8cde5f9a-b9b4-457d-90fa-7a4c14d38ddf', '34a62f13-0924-4014-8ff7-7152d79dc5f5', '315703c4-fbf0-4a85-a802-c0a83d99a045', '150d55ee-cb34-4ede-8278-d189d3a2ddb2'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:12 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:12 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:12 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-daed8b51-6c39-41b5-860a-4292e60dadcc 1073741824" returned: 0 in 0.593s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-daed8b51-6c39-41b5-860a-4292e60dadcc {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:12 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-daed8b51-6c39-41b5-860a-4292e60dadcc Jul 21 19:12:12 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:13 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.434s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:13 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] Deleted volume successfully. Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d8591a48-cf1a-4af2-8f4a-ba549275082b tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-fad2238d-e2b9-456a-a87a-40f870f1769a-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:13 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-daed8b51-6c39-41b5-860a-4292e60dadcc" returned: 0 in 0.318s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ed5127-8747-4dfc-95f5-a89d1fcec092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daed8b51-6c39-41b5-860a-4292e60dadcc', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb76db87-d2c3-4d22-8e33-ac9d4937bf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:13 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Volume volume-daed8b51-6c39-41b5-860a-4292e60dadcc (daed8b51-6c39-41b5-860a-4292e60dadcc): created successfully Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb76db87-d2c3-4d22-8e33-ac9d4937bf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Flow 'volume_create_manager' (b0e1e938-3a27-4672-ada3-ffa651573771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:13 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-79c09c6b-dccf-4f94-8049-29dc7dd3898f tempest-VolumesTransfersV355Test-222509513 None] Created volume successfully. Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Flow 'volume_create_manager' (564e8723-f785-4fa0-8668-05a4b646402a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aab89e6-80fe-48b2-91a4-606923348eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aab89e6-80fe-48b2-91a4-606923348eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1976057004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d46e3ae-5091-43c4-8f76-7b2b8cc87269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52fc07f89d64b8982c14b7f9f33bdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:14Z,use_quota=True,user_id='097a842e272d4a93ab2974ae8feb2f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6550da-96ac-4633-9946-f25e0cc26622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6550da-96ac-4633-9946-f25e0cc26622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e3cd7d-c5b3-42ab-a8a7-0622635a976a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e3cd7d-c5b3-42ab-a8a7-0622635a976a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d46e3ae-5091-43c4-8f76-7b2b8cc87269', 'volume_name': 'volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b719a4-b73b-4218-b013-096cebfaed72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b719a4-b73b-4218-b013-096cebfaed72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84e49b8-741d-4a24-bb9e-ea434e6c8e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:13 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Volume 9d46e3ae-5091-43c4-8f76-7b2b8cc87269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269', 'volume_size': 1} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1976057004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d46e3ae-5091-43c4-8f76-7b2b8cc87269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52fc07f89d64b8982c14b7f9f33bdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:14Z,use_quota=True,user_id='097a842e272d4a93ab2974ae8feb2f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Creating volume 9d46e3ae-5091-43c4-8f76-7b2b8cc87269 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:13 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:12:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:13 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 1073741824 Jul 21 19:12:13 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:14 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 1073741824" returned: 0 in 0.589s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:14 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 Jul 21 19:12:14 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:14 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269" returned: 0 in 0.305s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84e49b8-741d-4a24-bb9e-ea434e6c8e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86da4d1d-6a45-4632-abc0-64513380253b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:14 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Volume volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 (9d46e3ae-5091-43c4-8f76-7b2b8cc87269): created successfully Jul 21 19:12:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86da4d1d-6a45-4632-abc0-64513380253b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Flow 'volume_create_manager' (564e8723-f785-4fa0-8668-05a4b646402a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:14 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-b8810842-7dd1-4a66-a2a3-23f599cdffba tempest-VolumesSnapshotTestJSON-493745841 None] Created volume successfully. Jul 21 19:12:15 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-033cf59c-7aad-4c83-b83b-5cf6ad578f70 tempest-VolumesTransfersV355Test-407959232 None] Transfer volume completed successfully. Jul 21 19:12:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] Acquiring lock "cinder-daed8b51-6c39-41b5-860a-4292e60dadcc-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] Lock "cinder-daed8b51-6c39-41b5-860a-4292e60dadcc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] Acquiring lock "cinder-quobyte-daed8b51-6c39-41b5-860a-4292e60dadcc" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] Lock "cinder-quobyte-daed8b51-6c39-41b5-860a-4292e60dadcc" acquired by "delete_volume" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:15 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[3644a919-d533-44a1-b664-151ee44d15b5]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-daed8b51-6c39-41b5-860a-4292e60dadcc {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:16 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-daed8b51-6c39-41b5-860a-4292e60dadcc Jul 21 19:12:16 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] Creating offline snapshot 7edcd102-9e31-4b3e-b6f7-4985bf05a798 of volume 9d46e3ae-5091-43c4-8f76-7b2b8cc87269 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc50a0ff-ea90-4771-9da3-c643c381854e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:16 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 Jul 21 19:12:16 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:16 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-daed8b51-6c39-41b5-860a-4292e60dadcc" returned: 0 in 0.470s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-daed8b51-6c39-41b5-860a-4292e60dadcc {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:16 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-daed8b51-6c39-41b5-860a-4292e60dadcc Jul 21 19:12:16 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:16 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269" returned: 0 in 0.433s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:16 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798 1G Jul 21 19:12:16 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:16 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-daed8b51-6c39-41b5-860a-4292e60dadcc" returned: 0 in 0.294s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] Lock "cinder-quobyte-daed8b51-6c39-41b5-860a-4292e60dadcc" released by "delete_volume" :: held 0.816s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] Created reservations ['ac3bb5d6-b78f-4c01-82f1-03e58b525a20', 'a80997d7-cae3-4110-be6a-5950d3a802df', 'b98fb293-f29e-43cb-bf39-6bf297c6fb49', '79048083-ac69-4d67-8790-7e58bbc9eb58'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:16 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:16 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:17 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798 1G" returned: 0 in 0.586s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:17 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.315s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:17 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] Deleted volume successfully. Jul 21 19:12:17 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798 Jul 21 19:12:17 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-149f5d1a-7494-4c6f-b6cb-255a3754f11d tempest-VolumesTransfersV355Test-506851761 None] Lock "cinder-daed8b51-6c39-41b5-860a-4292e60dadcc-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:17 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798" returned: 0 in 0.493s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:17 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798 is being set with open permissions: ugo+rw Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:17 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798 Jul 21 19:12:17 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Flow 'volume_create_manager' (22f71cc0-7c76-4a90-abe8-7b945671ebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d8eecc-df2c-45bb-83cb-3353cf5971ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d8eecc-df2c-45bb-83cb-3353cf5971ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-444277280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d36dd5-85d8-42c6-bfe5-1e285d7235bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad62faa11b264f449ee54ff79d7f674f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:18Z,use_quota=True,user_id='54f1d9df3a6d4426be7f91acf5805e76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595328a0-851f-4474-a27e-12c99fea5b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595328a0-851f-4474-a27e-12c99fea5b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9826636-2b5b-4815-bbe6-a45465535c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9826636-2b5b-4815-bbe6-a45465535c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69d36dd5-85d8-42c6-bfe5-1e285d7235bc', 'volume_name': 'volume-69d36dd5-85d8-42c6-bfe5-1e285d7235bc', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf076794-273a-4dcf-a021-bb97864832bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf076794-273a-4dcf-a021-bb97864832bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6065cc-823b-49f0-96ea-774307302e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:17 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Volume 69d36dd5-85d8-42c6-bfe5-1e285d7235bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69d36dd5-85d8-42c6-bfe5-1e285d7235bc', 'volume_size': 1} Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:17 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798" returned: 0 in 0.314s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:17 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.info Jul 21 19:12:17 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:18 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.info" returned: 0 in 0.283s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:18 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.info is being set with open permissions: ugo+rw Jul 21 19:12:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:18 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.info Jul 21 19:12:18 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:18 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.info" returned: 0 in 0.275s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.489s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.735s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-444277280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d36dd5-85d8-42c6-bfe5-1e285d7235bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad62faa11b264f449ee54ff79d7f674f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:18Z,use_quota=True,user_id='54f1d9df3a6d4426be7f91acf5805e76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Creating volume 69d36dd5-85d8-42c6-bfe5-1e285d7235bc {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:18 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:12:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-69d36dd5-85d8-42c6-bfe5-1e285d7235bc 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:18 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-69d36dd5-85d8-42c6-bfe5-1e285d7235bc 1073741824 Jul 21 19:12:18 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:18 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-a64960ec-5e1b-4c9c-88ca-bc9340ad8fb2 tempest-VolumesSnapshotTestJSON-493745841 None] Create snapshot completed successfully Jul 21 19:12:19 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-69d36dd5-85d8-42c6-bfe5-1e285d7235bc 1073741824" returned: 0 in 0.494s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-69d36dd5-85d8-42c6-bfe5-1e285d7235bc {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:19 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-69d36dd5-85d8-42c6-bfe5-1e285d7235bc Jul 21 19:12:19 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:19 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-69d36dd5-85d8-42c6-bfe5-1e285d7235bc" returned: 0 in 0.329s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:19 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6065cc-823b-49f0-96ea-774307302e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69d36dd5-85d8-42c6-bfe5-1e285d7235bc', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22fde04-33a3-4a52-8d01-e6833553fb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:19 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Volume volume-69d36dd5-85d8-42c6-bfe5-1e285d7235bc (69d36dd5-85d8-42c6-bfe5-1e285d7235bc): created successfully Jul 21 19:12:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22fde04-33a3-4a52-8d01-e6833553fb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:19 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Flow 'volume_create_manager' (22f71cc0-7c76-4a90-abe8-7b945671ebbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:19 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-6dc8fb55-0649-4f46-8a11-96116bde4fae tempest-VolumesTransfersV355Test-222509513 None] Created volume successfully. Jul 21 19:12:19 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Flow 'volume_create_manager' (20ae43c4-0e77-4065-b0eb-7e8e0064de81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b9eb42-e17d-45b5-a2ec-ae8b42c198fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b9eb42-e17d-45b5-a2ec-ae8b42c198fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-708249402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ddaac28-f70a-4523-ab8b-8fdff7d84d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52fc07f89d64b8982c14b7f9f33bdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7edcd102-9e31-4b3e-b6f7-4985bf05a798,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:20Z,use_quota=True,user_id='097a842e272d4a93ab2974ae8feb2f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a586fa5-5d5a-4ec5-b55a-7a80fa5d0e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a586fa5-5d5a-4ec5-b55a-7a80fa5d0e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a222af-3c61-4208-bf33-7ae823a169aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a222af-3c61-4208-bf33-7ae823a169aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0ddaac28-f70a-4523-ab8b-8fdff7d84d7d', 'volume_name': 'volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d', 'volume_size': 1, 'snapshot_id': '7edcd102-9e31-4b3e-b6f7-4985bf05a798'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346033b9-c12b-4c8e-893e-614d9f3da5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346033b9-c12b-4c8e-893e-614d9f3da5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a571406d-e000-4d56-aaa7-020d3af88fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:20 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Volume 0ddaac28-f70a-4523-ab8b-8fdff7d84d7d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d', 'volume_size': 1, 'snapshot_id': '7edcd102-9e31-4b3e-b6f7-4985bf05a798'} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-quobyte-7edcd102-9e31-4b3e-b6f7-4985bf05a798-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d" by "_create_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] Acquiring lock "cinder-69d36dd5-85d8-42c6-bfe5-1e285d7235bc-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-7edcd102-9e31-4b3e-b6f7-4985bf05a798-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Creating volume 0ddaac28-f70a-4523-ab8b-8fdff7d84d7d from snapshot 7edcd102-9e31-4b3e-b6f7-4985bf05a798 {{(pid=87570) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-quobyte-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d" by "_copy_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] Lock "cinder-69d36dd5-85d8-42c6-bfe5-1e285d7235bc-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] snapshot: 7edcd102-9e31-4b3e-b6f7-4985bf05a798, volume: 0ddaac28-f70a-4523-ab8b-8fdff7d84d7d, {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] Acquiring lock "cinder-quobyte-69d36dd5-85d8-42c6-bfe5-1e285d7235bc" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7fae23-04b6-4a49-a29a-201c5ca1a932]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] Lock "cinder-quobyte-69d36dd5-85d8-42c6-bfe5-1e285d7235bc" acquired by "delete_volume" :: waited 0.026s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bb9d64-8e8a-43c8-92ad-1eff61d5d9d6]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-69d36dd5-85d8-42c6-bfe5-1e285d7235bc {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:20 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798 Jul 21 19:12:20 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:20 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-69d36dd5-85d8-42c6-bfe5-1e285d7235bc Jul 21 19:12:20 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:20 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798" returned: 0 in 0.496s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Creating direct copy from snapshot {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[68399d23-54a3-4c1a-9f24-16be01334a92]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:20 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-69d36dd5-85d8-42c6-bfe5-1e285d7235bc" returned: 0 in 0.485s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-69d36dd5-85d8-42c6-bfe5-1e285d7235bc {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:20 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-69d36dd5-85d8-42c6-bfe5-1e285d7235bc Jul 21 19:12:20 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:20 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 Jul 21 19:12:20 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:21 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-69d36dd5-85d8-42c6-bfe5-1e285d7235bc" returned: 0 in 0.308s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] Lock "cinder-quobyte-69d36dd5-85d8-42c6-bfe5-1e285d7235bc" released by "delete_volume" :: held 0.858s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:21 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] Created reservations ['43c1fc43-0d1d-429e-9428-e4799200bb29', '3ed09dc0-7e43-4f59-8571-5f5a4f95ded2', '892090a2-c9db-47fb-863d-e33ff2b85dc7', '4be20323-417e-4720-b88e-906bd26cbb7b'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:21 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269" returned: 0 in 0.436s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:21 devstack cinder-volume[87570]: DEBUG cinder.utils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Path /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d not found in is_blk_device check {{(pid=87570) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:12:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:21 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d Jul 21 19:12:21 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:21 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:21 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:21 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.339s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:21 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:21 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] Deleted volume successfully. Jul 21 19:12:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e2c3ca79-b14e-45b8-b856-9a3f40685a45 tempest-VolumesTransfersV355Test-506851761 None] Lock "cinder-69d36dd5-85d8-42c6-bfe5-1e285d7235bc-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:24 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Flow 'volume_create_manager' (d4cec7fc-03d5-4a8e-806d-a3c385d5da4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e938ef83-abea-4be8-8a43-8964b20fd82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e938ef83-abea-4be8-8a43-8964b20fd82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-994356820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1300329-0f0e-4577-b280-74a12884d1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e405bdcca9924420bca357036272f90d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:24Z,use_quota=True,user_id='6e25758289d24a56b536415054b253fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b259174-e7b2-4999-9860-28a05560a276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b259174-e7b2-4999-9860-28a05560a276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ae3114-6e12-42dc-98bd-9d5548c38db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ae3114-6e12-42dc-98bd-9d5548c38db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1300329-0f0e-4577-b280-74a12884d1eb', 'volume_name': 'volume-b1300329-0f0e-4577-b280-74a12884d1eb', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45318aa8-6047-4687-8013-972bbec14594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45318aa8-6047-4687-8013-972bbec14594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea88e61-50c6-4863-89a0-f447702185b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:24 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Volume b1300329-0f0e-4577-b280-74a12884d1eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1300329-0f0e-4577-b280-74a12884d1eb', 'volume_size': 1} Jul 21 19:12:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:25 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Flow 'volume_create_manager' (adc043ce-e57e-4584-b1ef-906e83fe0777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf713c42-7ef1-4964-ba5d-3663bda525f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf713c42-7ef1-4964-ba5d-3663bda525f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2035038653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4f32c8-987a-4b12-81cc-483b5967aad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e405bdcca9924420bca357036272f90d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:25Z,use_quota=True,user_id='6e25758289d24a56b536415054b253fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228f149d-736c-4936-81e1-6230d7336c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228f149d-736c-4936-81e1-6230d7336c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6937f8d-3d4e-420b-aaa1-6be5e3db2312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6937f8d-3d4e-420b-aaa1-6be5e3db2312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d4f32c8-987a-4b12-81cc-483b5967aad0', 'volume_name': 'volume-3d4f32c8-987a-4b12-81cc-483b5967aad0', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12d40dc-e93c-4175-99bb-ce06dded96e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12d40dc-e93c-4175-99bb-ce06dded96e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1b2e35-6535-4289-b5b7-e5e143d55db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:25 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Volume 3d4f32c8-987a-4b12-81cc-483b5967aad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d4f32c8-987a-4b12-81cc-483b5967aad0', 'volume_size': 1} Jul 21 19:12:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:26 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Flow 'volume_create_manager' (ca4763b8-2f3d-4595-ab9f-4a809f39a424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa99a914-6568-4673-98f0-d6eee424739b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa99a914-6568-4673-98f0-d6eee424739b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1200861672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b1e5d1-0b02-46e2-a3eb-32a09062eece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e405bdcca9924420bca357036272f90d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:26Z,use_quota=True,user_id='6e25758289d24a56b536415054b253fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c05bb2-5da0-4cc1-bb51-4b6b584c8d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c05bb2-5da0-4cc1-bb51-4b6b584c8d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08778ded-c068-4459-883b-07094ca81e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08778ded-c068-4459-883b-07094ca81e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9b1e5d1-0b02-46e2-a3eb-32a09062eece', 'volume_name': 'volume-c9b1e5d1-0b02-46e2-a3eb-32a09062eece', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecfb7f40-49b3-4267-bd76-9afcf8fbb834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecfb7f40-49b3-4267-bd76-9afcf8fbb834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d715a860-fe6c-4491-be97-851233183036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:26 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Volume c9b1e5d1-0b02-46e2-a3eb-32a09062eece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9b1e5d1-0b02-46e2-a3eb-32a09062eece', 'volume_size': 1} Jul 21 19:12:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:27 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Flow 'volume_create_manager' (14735f98-13a8-4cae-9ad8-ba0785c1d3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d61a7e-ab6d-4178-aeac-2570e5cebd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d61a7e-ab6d-4178-aeac-2570e5cebd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1261976925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698f7e36-5d0a-4dcd-93d7-d6c990641771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e405bdcca9924420bca357036272f90d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:27Z,use_quota=True,user_id='6e25758289d24a56b536415054b253fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86363f8-1e42-4501-a6f6-83c6581eac9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86363f8-1e42-4501-a6f6-83c6581eac9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:27 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bed59fd-556c-4a08-9a2f-640d2a726d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bed59fd-556c-4a08-9a2f-640d2a726d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '698f7e36-5d0a-4dcd-93d7-d6c990641771', 'volume_name': 'volume-698f7e36-5d0a-4dcd-93d7-d6c990641771', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea61cd9-c752-4c3e-b434-756e81c79d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea61cd9-c752-4c3e-b434-756e81c79d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f334da-5841-4cc5-8302-8f71fe8eedc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:27 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Volume 698f7e36-5d0a-4dcd-93d7-d6c990641771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-698f7e36-5d0a-4dcd-93d7-d6c990641771', 'volume_size': 1} Jul 21 19:12:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d" returned: 0 in 6.540s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:27 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bce352-becb-469a-ae67-97e9e8ded57b]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:28 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 Jul 21 19:12:28 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Flow 'volume_create_manager' (3b8c290b-4ebe-4c43-a441-e37bc688f08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd76efc-df7b-4a09-a23f-94a525eb32c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd76efc-df7b-4a09-a23f-94a525eb32c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1320593586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06cba147-dd29-4a31-81e5-c4657ce1164c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e405bdcca9924420bca357036272f90d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:28Z,use_quota=True,user_id='6e25758289d24a56b536415054b253fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd73e7cd-cde6-45b5-a49a-3a2cd7332e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd73e7cd-cde6-45b5-a49a-3a2cd7332e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db96c7c7-02f3-4ce9-afd1-598748c4afdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db96c7c7-02f3-4ce9-afd1-598748c4afdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06cba147-dd29-4a31-81e5-c4657ce1164c', 'volume_name': 'volume-06cba147-dd29-4a31-81e5-c4657ce1164c', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2409f8dc-870e-4d62-9e0e-a1ac1cede288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2409f8dc-870e-4d62-9e0e-a1ac1cede288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f518477-6c0d-4ebd-bd7c-149edd9315c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:28 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Volume 06cba147-dd29-4a31-81e5-c4657ce1164c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06cba147-dd29-4a31-81e5-c4657ce1164c', 'volume_size': 1} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:28 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269" returned: 0 in 0.812s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Image conversion details: src /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269, size 1024.00 MB, duration 6.54 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:12:28 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Converted 1024.00 MB image at 156.52 MB/s Jul 21 19:12:28 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d is being set with open permissions: ugo+rw Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:28 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d Jul 21 19:12:28 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:28 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d" returned: 0 in 0.281s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d" released by "_copy_volume_from_snapshot" :: held 8.683s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-7edcd102-9e31-4b3e-b6f7-4985bf05a798-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d" released by "_create_volume_from_snapshot" :: held 8.732s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.769s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.479s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-994356820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1300329-0f0e-4577-b280-74a12884d1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e405bdcca9924420bca357036272f90d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:24Z,use_quota=True,user_id='6e25758289d24a56b536415054b253fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Creating volume b1300329-0f0e-4577-b280-74a12884d1eb {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:28 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b1300329-0f0e-4577-b280-74a12884d1eb 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:28 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b1300329-0f0e-4577-b280-74a12884d1eb 1073741824 Jul 21 19:12:28 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a571406d-e000-4d56-aaa7-020d3af88fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d', 'volume_size': 1, 'snapshot_id': '7edcd102-9e31-4b3e-b6f7-4985bf05a798'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19709b52-7041-47fc-a251-82bdfa120d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:29 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Volume volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d (0ddaac28-f70a-4523-ab8b-8fdff7d84d7d): created successfully Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19709b52-7041-47fc-a251-82bdfa120d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Flow 'volume_create_manager' (20ae43c4-0e77-4065-b0eb-7e8e0064de81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:29 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c8db7d6e-5b1f-4d06-87a9-8721c18b1b4c tempest-VolumesSnapshotTestJSON-493745841 None] Created volume successfully. Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-quobyte-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d" acquired by "delete_volume" :: waited 0.025s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9896c0-e7cb-4d0c-a84c-4429c1247aab]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:29 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d Jul 21 19:12:29 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:29 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b1300329-0f0e-4577-b280-74a12884d1eb 1073741824" returned: 0 in 0.604s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b1300329-0f0e-4577-b280-74a12884d1eb {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:29 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b1300329-0f0e-4577-b280-74a12884d1eb Jul 21 19:12:29 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:29 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b1300329-0f0e-4577-b280-74a12884d1eb" returned: 0 in 0.315s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:29 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.500s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2035038653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4f32c8-987a-4b12-81cc-483b5967aad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e405bdcca9924420bca357036272f90d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:25Z,use_quota=True,user_id='6e25758289d24a56b536415054b253fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Creating volume 3d4f32c8-987a-4b12-81cc-483b5967aad0 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:29 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3d4f32c8-987a-4b12-81cc-483b5967aad0 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d" returned: 0 in 0.507s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:29 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3d4f32c8-987a-4b12-81cc-483b5967aad0 1073741824 Jul 21 19:12:29 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea88e61-50c6-4863-89a0-f447702185b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1300329-0f0e-4577-b280-74a12884d1eb', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:29 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d Jul 21 19:12:29 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf4b50d-2e5f-43d6-9b15-bf75e974d9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:29 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Volume volume-b1300329-0f0e-4577-b280-74a12884d1eb (b1300329-0f0e-4577-b280-74a12884d1eb): created successfully Jul 21 19:12:29 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf4b50d-2e5f-43d6-9b15-bf75e974d9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Flow 'volume_create_manager' (d4cec7fc-03d5-4a8e-806d-a3c385d5da4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:30 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-eb948cca-554f-4261-bd8c-348667b73374 tempest-CreateVolumesFromImageTest-181397090 None] Created volume successfully. Jul 21 19:12:30 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d" returned: 0 in 0.292s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d" released by "delete_volume" :: held 0.857s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] Created reservations ['cb803419-9883-4e7c-a0f5-50c269a91848', '1fc08275-41db-4b26-aa69-749721557f27', 'f018b6df-70fc-481e-98b0-7203d7aa9855', '93478d73-52e1-4045-81e2-cea64b0feda8'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:30 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:30 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:30 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3d4f32c8-987a-4b12-81cc-483b5967aad0 1073741824" returned: 0 in 0.580s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3d4f32c8-987a-4b12-81cc-483b5967aad0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:30 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3d4f32c8-987a-4b12-81cc-483b5967aad0 Jul 21 19:12:30 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-7edcd102-9e31-4b3e-b6f7-4985bf05a798-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-7edcd102-9e31-4b3e-b6f7-4985bf05a798-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-quobyte-9d46e3ae-5091-43c4-8f76-7b2b8cc87269" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-9d46e3ae-5091-43c4-8f76-7b2b8cc87269" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-quobyte-7edcd102-9e31-4b3e-b6f7-4985bf05a798" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-7edcd102-9e31-4b3e-b6f7-4985bf05a798" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] Deleting offline snapshot 7edcd102-9e31-4b3e-b6f7-4985bf05a798 of volume 9d46e3ae-5091-43c4-8f76-7b2b8cc87269 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:12:30 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] snapshot_file for this snap is: volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.304s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:30 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] Deleted volume successfully. Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb44dfe-333a-4695-ab83-0c2ad4aae87d]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bd2fe1bd-8b08-4f68-a753-593aca49be5f tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-0ddaac28-f70a-4523-ab8b-8fdff7d84d7d-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:30 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798 Jul 21 19:12:30 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:30 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3d4f32c8-987a-4b12-81cc-483b5967aad0" returned: 0 in 0.351s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.408s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1200861672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b1e5d1-0b02-46e2-a3eb-32a09062eece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e405bdcca9924420bca357036272f90d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:26Z,use_quota=True,user_id='6e25758289d24a56b536415054b253fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Creating volume c9b1e5d1-0b02-46e2-a3eb-32a09062eece {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:30 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c9b1e5d1-0b02-46e2-a3eb-32a09062eece 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1b2e35-6535-4289-b5b7-e5e143d55db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d4f32c8-987a-4b12-81cc-483b5967aad0', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1d0ba0-698b-4b0a-ab14-fe57109d3bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:30 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c9b1e5d1-0b02-46e2-a3eb-32a09062eece 1073741824 Jul 21 19:12:30 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:30 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Volume volume-3d4f32c8-987a-4b12-81cc-483b5967aad0 (3d4f32c8-987a-4b12-81cc-483b5967aad0): created successfully Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1d0ba0-698b-4b0a-ab14-fe57109d3bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:30 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Flow 'volume_create_manager' (adc043ce-e57e-4584-b1ef-906e83fe0777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:31 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-75fb4077-de74-44f1-9cc0-f6337cc1125c tempest-CreateVolumesFromImageTest-181397090 None] Created volume successfully. Jul 21 19:12:31 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798" returned: 0 in 0.399s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e300bab-2399-4bad-b005-55e30a242b41]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:31 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 Jul 21 19:12:31 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:31 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c9b1e5d1-0b02-46e2-a3eb-32a09062eece 1073741824" returned: 0 in 0.547s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c9b1e5d1-0b02-46e2-a3eb-32a09062eece {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:31 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c9b1e5d1-0b02-46e2-a3eb-32a09062eece Jul 21 19:12:31 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:31 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269" returned: 0 in 0.416s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:31 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798 Jul 21 19:12:31 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:31 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c9b1e5d1-0b02-46e2-a3eb-32a09062eece" returned: 0 in 0.283s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1261976925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698f7e36-5d0a-4dcd-93d7-d6c990641771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e405bdcca9924420bca357036272f90d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:27Z,use_quota=True,user_id='6e25758289d24a56b536415054b253fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Creating volume 698f7e36-5d0a-4dcd-93d7-d6c990641771 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:31 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-698f7e36-5d0a-4dcd-93d7-d6c990641771 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d715a860-fe6c-4491-be97-851233183036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9b1e5d1-0b02-46e2-a3eb-32a09062eece', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:31 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-698f7e36-5d0a-4dcd-93d7-d6c990641771 1073741824 Jul 21 19:12:31 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1ceebb-24c8-47cf-a525-cd68c06526bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:31 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Volume volume-c9b1e5d1-0b02-46e2-a3eb-32a09062eece (c9b1e5d1-0b02-46e2-a3eb-32a09062eece): created successfully Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1ceebb-24c8-47cf-a525-cd68c06526bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Flow 'volume_create_manager' (ca4763b8-2f3d-4595-ab9f-4a809f39a424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:31 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-2b71a1f8-71c6-4728-b427-de97f8f2cc3e tempest-CreateVolumesFromImageTest-181397090 None] Created volume successfully. Jul 21 19:12:32 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798" returned: 0 in 0.408s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:32 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798 Jul 21 19:12:32 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:32 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:32 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-698f7e36-5d0a-4dcd-93d7-d6c990641771 1073741824" returned: 0 in 0.494s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269.7edcd102-9e31-4b3e-b6f7-4985bf05a798" returned: 0 in 0.304s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-7edcd102-9e31-4b3e-b6f7-4985bf05a798" released by "_delete_snapshot" :: held 1.676s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-9d46e3ae-5091-43c4-8f76-7b2b8cc87269" released by "delete_snapshot" :: held 1.711s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-698f7e36-5d0a-4dcd-93d7-d6c990641771 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:32 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-698f7e36-5d0a-4dcd-93d7-d6c990641771 Jul 21 19:12:32 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] Created reservations ['655e4329-7851-4bad-9d82-413a55957507', 'f37d18ef-b44d-49ed-b7a5-dc13ff94481e', '8e155aa3-ee81-4ae6-8a28-c975467d0d98', '68d48f25-dd4f-4f90-9030-06a9a2bb58fb'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:32 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] Delete snapshot completed successfully. Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d44875c6-65c2-4c35-bbed-ce0be78ad82b tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-7edcd102-9e31-4b3e-b6f7-4985bf05a798-delete_snapshot" released by "delete_snapshot" :: held 1.909s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:32 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-698f7e36-5d0a-4dcd-93d7-d6c990641771" returned: 0 in 0.291s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.412s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1320593586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06cba147-dd29-4a31-81e5-c4657ce1164c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e405bdcca9924420bca357036272f90d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:28Z,use_quota=True,user_id='6e25758289d24a56b536415054b253fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Creating volume 06cba147-dd29-4a31-81e5-c4657ce1164c {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:32 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-06cba147-dd29-4a31-81e5-c4657ce1164c 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f334da-5841-4cc5-8302-8f71fe8eedc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-698f7e36-5d0a-4dcd-93d7-d6c990641771', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:32 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-06cba147-dd29-4a31-81e5-c4657ce1164c 1073741824 Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2a75f2-f726-4f82-a7b0-ed7839260fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:32 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:32 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Volume volume-698f7e36-5d0a-4dcd-93d7-d6c990641771 (698f7e36-5d0a-4dcd-93d7-d6c990641771): created successfully Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2a75f2-f726-4f82-a7b0-ed7839260fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Flow 'volume_create_manager' (14735f98-13a8-4cae-9ad8-ba0785c1d3e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:32 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-5cffe80d-875e-4f24-b9de-96dbc41974b0 tempest-CreateVolumesFromImageTest-181397090 None] Created volume successfully. Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-9d46e3ae-5091-43c4-8f76-7b2b8cc87269-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-9d46e3ae-5091-43c4-8f76-7b2b8cc87269-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-quobyte-9d46e3ae-5091-43c4-8f76-7b2b8cc87269" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-9d46e3ae-5091-43c4-8f76-7b2b8cc87269" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dba097-e7e9-4a19-80d2-1377c1ccbae9]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:33 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 Jul 21 19:12:33 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:33 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-06cba147-dd29-4a31-81e5-c4657ce1164c 1073741824" returned: 0 in 0.536s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-06cba147-dd29-4a31-81e5-c4657ce1164c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:33 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-06cba147-dd29-4a31-81e5-c4657ce1164c Jul 21 19:12:33 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:33 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269" returned: 0 in 0.447s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:33 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269 Jul 21 19:12:33 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:33 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-06cba147-dd29-4a31-81e5-c4657ce1164c" returned: 0 in 0.311s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f518477-6c0d-4ebd-bd7c-149edd9315c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06cba147-dd29-4a31-81e5-c4657ce1164c', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8377b2f0-7cb2-4966-ae78-82dfa30bfb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:33 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Volume volume-06cba147-dd29-4a31-81e5-c4657ce1164c (06cba147-dd29-4a31-81e5-c4657ce1164c): created successfully Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8377b2f0-7cb2-4966-ae78-82dfa30bfb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Flow 'volume_create_manager' (3b8c290b-4ebe-4c43-a441-e37bc688f08c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:33 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4f51ab4d-d047-41cb-9198-e8726406c707 tempest-CreateVolumesFromImageTest-181397090 None] Created volume successfully. Jul 21 19:12:33 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d46e3ae-5091-43c4-8f76-7b2b8cc87269" returned: 0 in 0.300s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-9d46e3ae-5091-43c4-8f76-7b2b8cc87269" released by "delete_volume" :: held 0.826s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] Created reservations ['532eaf00-d4e2-47d7-9cc0-38ed8c73e860', '56fb77da-dcd0-4849-bafe-5577566cfa1e', 'a8b4c126-c75d-430b-b8d4-a3bd1a671eb6', '260f0b51-29e3-4d31-b04e-a3a08a82e6e2'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "cinder-06cba147-dd29-4a31-81e5-c4657ce1164c-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-06cba147-dd29-4a31-81e5-c4657ce1164c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "cinder-quobyte-06cba147-dd29-4a31-81e5-c4657ce1164c" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-quobyte-06cba147-dd29-4a31-81e5-c4657ce1164c" acquired by "delete_volume" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[8470cdf5-a077-43b5-8eec-f7c50b15a36c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-06cba147-dd29-4a31-81e5-c4657ce1164c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:34 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:34 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-e8e31e13-b3e2-42a5-82a1-25f1c0a26261-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Flow 'volume_create_manager' (c6268b1c-46f5-4a2e-ba80-e2f377e3bed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c2a4ed-a117-4bde-b908-21fc2dae389c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:34 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-06cba147-dd29-4a31-81e5-c4657ce1164c Jul 21 19:12:34 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c2a4ed-a117-4bde-b908-21fc2dae389c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-279810069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae87465-a326-44fe-92f4-c07873a17f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a499bc61194c2c9571a8829d6d4cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:34Z,use_quota=True,user_id='9db4c5be0cf74712a8c02d68fedf8e97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a86cc4-77d3-4052-92f5-6722052d1af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a86cc4-77d3-4052-92f5-6722052d1af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bd574d-f15f-4715-a116-04100ff86754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bd574d-f15f-4715-a116-04100ff86754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ae87465-a326-44fe-92f4-c07873a17f3e', 'volume_name': 'volume-9ae87465-a326-44fe-92f4-c07873a17f3e', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b997462-3be2-443e-97d1-187db51f6072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b997462-3be2-443e-97d1-187db51f6072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce9174e-6862-41cd-9506-4c827f45777c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:34 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Volume 9ae87465-a326-44fe-92f4-c07873a17f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ae87465-a326-44fe-92f4-c07873a17f3e', 'volume_size': 1} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-279810069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae87465-a326-44fe-92f4-c07873a17f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a499bc61194c2c9571a8829d6d4cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:34Z,use_quota=True,user_id='9db4c5be0cf74712a8c02d68fedf8e97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Creating volume 9ae87465-a326-44fe-92f4-c07873a17f3e {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:34 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ae87465-a326-44fe-92f4-c07873a17f3e 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-e8e31e13-b3e2-42a5-82a1-25f1c0a26261-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:34 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ae87465-a326-44fe-92f4-c07873a17f3e 1073741824 Jul 21 19:12:34 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "cinder-quobyte-e8e31e13-b3e2-42a5-82a1-25f1c0a26261" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-e8e31e13-b3e2-42a5-82a1-25f1c0a26261" acquired by "delete_volume" :: waited 0.025s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:34 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.364s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:34 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] Deleted volume successfully. Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3b5a08-c1c9-44eb-8970-215e72eae519]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-dab95950-3f01-4e17-af72-38b703e8904e tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-9d46e3ae-5091-43c4-8f76-7b2b8cc87269-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:34 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-06cba147-dd29-4a31-81e5-c4657ce1164c" returned: 0 in 0.460s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-06cba147-dd29-4a31-81e5-c4657ce1164c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:34 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-06cba147-dd29-4a31-81e5-c4657ce1164c Jul 21 19:12:34 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:34 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261 Jul 21 19:12:34 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:34 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-06cba147-dd29-4a31-81e5-c4657ce1164c" returned: 0 in 0.286s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:34 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ae87465-a326-44fe-92f4-c07873a17f3e 1073741824" returned: 0 in 0.532s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:34 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-quobyte-06cba147-dd29-4a31-81e5-c4657ce1164c" released by "delete_volume" :: held 0.818s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261" returned: 0 in 0.412s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:34 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261 Jul 21 19:12:34 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ae87465-a326-44fe-92f4-c07873a17f3e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:34 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ae87465-a326-44fe-92f4-c07873a17f3e Jul 21 19:12:34 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:34 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] Created reservations ['91b588f5-2d7b-4429-89b5-def389e5ccd4', 'c5d05357-b263-414c-bbc4-9766b51ecc5a', 'b71fffbc-0b03-4645-a758-06e2b4e0e816', '2e4a8be6-9205-4090-b469-d04a4d0e40c3'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:35 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:35 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "cinder-698f7e36-5d0a-4dcd-93d7-d6c990641771-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:35 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e8e31e13-b3e2-42a5-82a1-25f1c0a26261" returned: 0 in 0.319s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-698f7e36-5d0a-4dcd-93d7-d6c990641771-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-quobyte-e8e31e13-b3e2-42a5-82a1-25f1c0a26261" released by "delete_volume" :: held 0.837s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:35 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ae87465-a326-44fe-92f4-c07873a17f3e" returned: 0 in 0.355s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce9174e-6862-41cd-9506-4c827f45777c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae87465-a326-44fe-92f4-c07873a17f3e', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (419622df-e7cf-462e-b82b-29ee0613762b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "cinder-quobyte-698f7e36-5d0a-4dcd-93d7-d6c990641771" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:35 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Volume volume-9ae87465-a326-44fe-92f4-c07873a17f3e (9ae87465-a326-44fe-92f4-c07873a17f3e): created successfully Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (419622df-e7cf-462e-b82b-29ee0613762b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Flow 'volume_create_manager' (c6268b1c-46f5-4a2e-ba80-e2f377e3bed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-quobyte-698f7e36-5d0a-4dcd-93d7-d6c990641771" acquired by "delete_volume" :: waited 0.036s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:35 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8e182bcd-a813-4534-af6c-591f352285e7 tempest-VolumesTransfersV357Test-1496979259 None] Created volume successfully. Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7ce9d0-00d4-483d-baac-3f1a0644df12]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-698f7e36-5d0a-4dcd-93d7-d6c990641771 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] Created reservations ['2d323e9d-eeb6-449b-a51f-f388be0b14ed', 'bb121f7c-2658-4453-af80-bfd8b98790b4', 'fde3c9e7-9804-47e9-8daf-550735718559', '32d38141-7c17-4dc5-bc27-6724c79f881b'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:35 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.346s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:35 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] Deleted volume successfully. Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2a142b58-94cd-4293-9cbd-e29c3aee275d tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-06cba147-dd29-4a31-81e5-c4657ce1164c-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:35 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-698f7e36-5d0a-4dcd-93d7-d6c990641771 Jul 21 19:12:35 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:35 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:35 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:35 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:35 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-698f7e36-5d0a-4dcd-93d7-d6c990641771" returned: 0 in 0.393s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-698f7e36-5d0a-4dcd-93d7-d6c990641771 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.290s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:35 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] Deleted volume successfully. Jul 21 19:12:35 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-698f7e36-5d0a-4dcd-93d7-d6c990641771 Jul 21 19:12:35 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f8d1114d-0692-46cb-b8db-8d033d9fa6fb tempest-VolumesSnapshotTestJSON-493745841 None] Lock "cinder-e8e31e13-b3e2-42a5-82a1-25f1c0a26261-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:36 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-698f7e36-5d0a-4dcd-93d7-d6c990641771" returned: 0 in 0.244s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-quobyte-698f7e36-5d0a-4dcd-93d7-d6c990641771" released by "delete_volume" :: held 0.689s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] Created reservations ['bafa9d54-3215-4cda-8c9b-0ba6276a1a53', '826a1985-ec4b-463d-a37a-213a40b798cf', '219c2b20-c935-4388-9e7b-bd8f2aafd366', 'b3e67c28-907c-4dee-b4ac-b4ee2e86da37'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:36 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:36 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "cinder-c9b1e5d1-0b02-46e2-a3eb-32a09062eece-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-c9b1e5d1-0b02-46e2-a3eb-32a09062eece-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "cinder-quobyte-c9b1e5d1-0b02-46e2-a3eb-32a09062eece" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:36 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.294s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:36 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] Deleted volume successfully. Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-quobyte-c9b1e5d1-0b02-46e2-a3eb-32a09062eece" acquired by "delete_volume" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb599feb-7f9a-4944-a374-0bf1e7d4226f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c54f1eb6-021d-46f4-9cde-c583a6a1c243 tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-698f7e36-5d0a-4dcd-93d7-d6c990641771-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c9b1e5d1-0b02-46e2-a3eb-32a09062eece {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:36 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c9b1e5d1-0b02-46e2-a3eb-32a09062eece Jul 21 19:12:36 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:36 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c9b1e5d1-0b02-46e2-a3eb-32a09062eece" returned: 0 in 0.400s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c9b1e5d1-0b02-46e2-a3eb-32a09062eece {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:36 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c9b1e5d1-0b02-46e2-a3eb-32a09062eece Jul 21 19:12:36 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:37 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-965e8303-417c-410c-9387-f112b43d54f8 tempest-VolumesTransfersV357Test-1211238402 None] Transfer volume completed successfully. Jul 21 19:12:37 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c9b1e5d1-0b02-46e2-a3eb-32a09062eece" returned: 0 in 0.313s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-quobyte-c9b1e5d1-0b02-46e2-a3eb-32a09062eece" released by "delete_volume" :: held 0.775s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] Created reservations ['c588b420-6757-4278-8bde-3ba242194556', '85d0e24d-38d8-4855-a1da-98da88b12556', '6d12d051-e5a8-4003-8c22-c47788c25f44', '7770dba0-6bce-41f3-a584-fa5c4756fe60'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:37 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:37 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "cinder-3d4f32c8-987a-4b12-81cc-483b5967aad0-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-3d4f32c8-987a-4b12-81cc-483b5967aad0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "cinder-quobyte-3d4f32c8-987a-4b12-81cc-483b5967aad0" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-quobyte-3d4f32c8-987a-4b12-81cc-483b5967aad0" acquired by "delete_volume" :: waited 0.024s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] Acquiring lock "cinder-9ae87465-a326-44fe-92f4-c07873a17f3e-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[636efe47-3771-4b45-a5c1-b9f200f5c230]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] Lock "cinder-9ae87465-a326-44fe-92f4-c07873a17f3e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3d4f32c8-987a-4b12-81cc-483b5967aad0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] Acquiring lock "cinder-quobyte-9ae87465-a326-44fe-92f4-c07873a17f3e" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] Lock "cinder-quobyte-9ae87465-a326-44fe-92f4-c07873a17f3e" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:37 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.468s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:37 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] Deleted volume successfully. Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbafa2f3-855c-45ed-a058-f97b5df56e9f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ae87465-a326-44fe-92f4-c07873a17f3e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:37 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3d4f32c8-987a-4b12-81cc-483b5967aad0 Jul 21 19:12:37 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cac46416-7cef-433d-af1a-edd5cf4b4bfd tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-c9b1e5d1-0b02-46e2-a3eb-32a09062eece-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:38 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ae87465-a326-44fe-92f4-c07873a17f3e Jul 21 19:12:38 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:38 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3d4f32c8-987a-4b12-81cc-483b5967aad0" returned: 0 in 0.447s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3d4f32c8-987a-4b12-81cc-483b5967aad0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:38 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3d4f32c8-987a-4b12-81cc-483b5967aad0 Jul 21 19:12:38 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:38 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ae87465-a326-44fe-92f4-c07873a17f3e" returned: 0 in 0.455s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ae87465-a326-44fe-92f4-c07873a17f3e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:38 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ae87465-a326-44fe-92f4-c07873a17f3e Jul 21 19:12:38 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:38 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3d4f32c8-987a-4b12-81cc-483b5967aad0" returned: 0 in 0.306s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-quobyte-3d4f32c8-987a-4b12-81cc-483b5967aad0" released by "delete_volume" :: held 0.841s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=144,cinder:UPDATE=199,cinder:DELETE=18,cinder:INSERT=48 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=184,cinder:SELECT=154,cinder:INSERT=42,cinder:DELETE=17 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] Created reservations ['0a8a138c-aa43-4521-a473-a45aeab0eccb', '5e8df901-4a03-47db-9f48-cb356ee1152e', 'cc983876-1961-4e10-8a6f-f74f20b9c962', 'd003eced-23c5-4c18-9f11-e3d08e206df3'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:38 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ae87465-a326-44fe-92f4-c07873a17f3e" returned: 0 in 0.298s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] Lock "cinder-quobyte-9ae87465-a326-44fe-92f4-c07873a17f3e" released by "delete_volume" :: held 0.836s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:38 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:38 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] Created reservations ['10194b66-a3fa-4745-8f48-bb14dcc64e0f', '7373f3e3-d7fc-4d6c-99a3-77ad1fc5cdcd', 'ed374772-c608-46a7-bb53-efb7209102a1', 'd62a07f6-0e29-4cb8-8f49-05a9b2be3f55'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "cinder-b1300329-0f0e-4577-b280-74a12884d1eb-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-b1300329-0f0e-4577-b280-74a12884d1eb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:38 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "cinder-quobyte-b1300329-0f0e-4577-b280-74a12884d1eb" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:38 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:38 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-quobyte-b1300329-0f0e-4577-b280-74a12884d1eb" acquired by "delete_volume" :: waited 0.028s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4ccbf6-6867-4e83-b717-32af291f65f0]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b1300329-0f0e-4577-b280-74a12884d1eb {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:39 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.372s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:39 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] Deleted volume successfully. Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1f83322c-d15a-4bf4-95ce-e9c7ce656609 tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-3d4f32c8-987a-4b12-81cc-483b5967aad0-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:39 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b1300329-0f0e-4577-b280-74a12884d1eb Jul 21 19:12:39 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:39 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.372s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:39 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] Deleted volume successfully. Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b87546c7-193d-4003-b841-2f517b1212c2 tempest-VolumesTransfersV357Test-30776896 None] Lock "cinder-9ae87465-a326-44fe-92f4-c07873a17f3e-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:39 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b1300329-0f0e-4577-b280-74a12884d1eb" returned: 0 in 0.567s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b1300329-0f0e-4577-b280-74a12884d1eb {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:39 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b1300329-0f0e-4577-b280-74a12884d1eb Jul 21 19:12:39 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Flow 'volume_create_manager' (917e9c01-7609-4016-924b-0cf605ef6088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (540df02b-b8a7-4635-a569-39d28bd2029f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (540df02b-b8a7-4635-a569-39d28bd2029f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-391894862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485f464f-5a33-429e-9f2e-0e5023fb02ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a499bc61194c2c9571a8829d6d4cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:40Z,use_quota=True,user_id='9db4c5be0cf74712a8c02d68fedf8e97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47aa6a4-073c-46ba-a4a0-c08c7a15db2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47aa6a4-073c-46ba-a4a0-c08c7a15db2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefaa27b-51eb-4a11-8f1c-508e216dab38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefaa27b-51eb-4a11-8f1c-508e216dab38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '485f464f-5a33-429e-9f2e-0e5023fb02ea', 'volume_name': 'volume-485f464f-5a33-429e-9f2e-0e5023fb02ea', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6c4799-2746-4448-b458-e2cc0b088f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6c4799-2746-4448-b458-e2cc0b088f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3369d22-f360-4120-a92a-a26fbca1c702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:39 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Volume 485f464f-5a33-429e-9f2e-0e5023fb02ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-485f464f-5a33-429e-9f2e-0e5023fb02ea', 'volume_size': 1} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-391894862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485f464f-5a33-429e-9f2e-0e5023fb02ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a499bc61194c2c9571a8829d6d4cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:40Z,use_quota=True,user_id='9db4c5be0cf74712a8c02d68fedf8e97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Creating volume 485f464f-5a33-429e-9f2e-0e5023fb02ea {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:39 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-485f464f-5a33-429e-9f2e-0e5023fb02ea 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:39 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-485f464f-5a33-429e-9f2e-0e5023fb02ea 1073741824 Jul 21 19:12:39 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:39 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b1300329-0f0e-4577-b280-74a12884d1eb" returned: 0 in 0.309s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-quobyte-b1300329-0f0e-4577-b280-74a12884d1eb" released by "delete_volume" :: held 0.950s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] Created reservations ['54fa55d4-15cd-44f1-8ecc-f0bbdbfa0b6a', '114a70b5-1df0-4abb-babc-274c7c865dae', 'fa7a13d3-d9a2-40f9-b3f8-bab156c12acb', '4e54ba91-85dd-4e69-a35e-aaf927de5e80'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:40 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:40 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:40 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-485f464f-5a33-429e-9f2e-0e5023fb02ea 1073741824" returned: 0 in 0.654s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:40 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.345s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:40 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] Deleted volume successfully. Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-485f464f-5a33-429e-9f2e-0e5023fb02ea {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0d82db11-aa00-4c03-8464-3f112387eace tempest-CreateVolumesFromImageTest-181397090 None] Lock "cinder-b1300329-0f0e-4577-b280-74a12884d1eb-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:40 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-485f464f-5a33-429e-9f2e-0e5023fb02ea Jul 21 19:12:40 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:40 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-485f464f-5a33-429e-9f2e-0e5023fb02ea" returned: 0 in 0.270s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3369d22-f360-4120-a92a-a26fbca1c702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-485f464f-5a33-429e-9f2e-0e5023fb02ea', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b4ea3b-a316-46a6-b401-a4e099d9aad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:40 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Volume volume-485f464f-5a33-429e-9f2e-0e5023fb02ea (485f464f-5a33-429e-9f2e-0e5023fb02ea): created successfully Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b4ea3b-a316-46a6-b401-a4e099d9aad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Flow 'volume_create_manager' (917e9c01-7609-4016-924b-0cf605ef6088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:40 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-e33f1f90-a2b0-4ab3-ab6f-c2ed34b62623 tempest-VolumesTransfersV357Test-1496979259 None] Created volume successfully. Jul 21 19:12:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] Acquiring lock "cinder-485f464f-5a33-429e-9f2e-0e5023fb02ea-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] Lock "cinder-485f464f-5a33-429e-9f2e-0e5023fb02ea-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] Acquiring lock "cinder-quobyte-485f464f-5a33-429e-9f2e-0e5023fb02ea" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] Lock "cinder-quobyte-485f464f-5a33-429e-9f2e-0e5023fb02ea" acquired by "delete_volume" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:42 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[84196e62-b150-42dd-a89f-0a659f929662]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-485f464f-5a33-429e-9f2e-0e5023fb02ea {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:42 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-485f464f-5a33-429e-9f2e-0e5023fb02ea Jul 21 19:12:42 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:42 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-485f464f-5a33-429e-9f2e-0e5023fb02ea" returned: 0 in 0.460s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-485f464f-5a33-429e-9f2e-0e5023fb02ea {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:42 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-485f464f-5a33-429e-9f2e-0e5023fb02ea Jul 21 19:12:42 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:43 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-485f464f-5a33-429e-9f2e-0e5023fb02ea" returned: 0 in 0.316s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:43 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] Lock "cinder-quobyte-485f464f-5a33-429e-9f2e-0e5023fb02ea" released by "delete_volume" :: held 0.836s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:43 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] Created reservations ['6a1cf098-7ee0-42dc-b9db-226a76820632', '8550a0d9-043e-4954-b639-7c08c6f1f9f2', 'e194d5c5-2d6e-4717-bb83-8fa564d9a839', 'ab19a7f0-6cb8-4b66-a7d8-c2cc625c2866'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:43 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:43 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:43 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:43 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:43 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.324s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:43 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:43 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] Deleted volume successfully. Jul 21 19:12:43 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-015d33af-dccf-4c98-aaf9-be233c572b1b tempest-VolumesTransfersV357Test-30776896 None] Lock "cinder-485f464f-5a33-429e-9f2e-0e5023fb02ea-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Flow 'volume_create_manager' (090fd3a9-9d61-4c24-87ed-39117307ad09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86483c66-f952-4c6d-b044-113852576a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86483c66-f952-4c6d-b044-113852576a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1807446450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd71500e51944abf90e53f117052d96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:45Z,use_quota=True,user_id='8c8c39fc8224498893b46153beab2db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fceb89c3-7809-4e48-a3e0-847a62b711d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fceb89c3-7809-4e48-a3e0-847a62b711d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac4e898-82b3-4cfc-abce-0126be7ad15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac4e898-82b3-4cfc-abce-0126be7ad15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2', 'volume_name': 'volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12b7be3-7c47-4dfb-8208-e9152f5d706c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12b7be3-7c47-4dfb-8208-e9152f5d706c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e890af-4d53-43cc-86d0-eb48fa97c835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:44 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Volume 6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2', 'volume_size': 1} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1807446450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd71500e51944abf90e53f117052d96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:45Z,use_quota=True,user_id='8c8c39fc8224498893b46153beab2db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Creating volume 6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:44 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:12:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:44 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 1073741824 Jul 21 19:12:44 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:45 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 1073741824" returned: 0 in 0.565s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:45 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 Jul 21 19:12:45 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:45 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2" returned: 0 in 0.331s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e890af-4d53-43cc-86d0-eb48fa97c835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab0b1dd-3e23-48a0-95ab-8ceb1cbd96dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:45 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Volume volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 (6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2): created successfully Jul 21 19:12:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab0b1dd-3e23-48a0-95ab-8ceb1cbd96dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Flow 'volume_create_manager' (090fd3a9-9d61-4c24-87ed-39117307ad09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:45 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-05b61f73-01ae-4ba5-8040-3f5ddd0ccf23 tempest-VolumesSnapshotListTestJSON-1313820729 None] Created volume successfully. Jul 21 19:12:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:47 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] Creating offline snapshot a8846b97-5ce9-4b95-bac6-ee5abe19255e of volume 6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:12:47 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[efee063b-8b08-43b7-b778-652a70a55e61]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:47 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 Jul 21 19:12:47 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:47 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2" returned: 0 in 0.459s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:47 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e 1G Jul 21 19:12:47 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:48 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e 1G" returned: 0 in 0.566s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:48 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e Jul 21 19:12:48 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:48 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e" returned: 0 in 0.334s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:48 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e is being set with open permissions: ugo+rw Jul 21 19:12:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:48 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e Jul 21 19:12:48 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:48 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e" returned: 0 in 0.275s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:48 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Flow 'volume_create_manager' (36a64052-2c4f-4131-947f-3ebe80b3410f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d040a3-47e4-4a1f-b2a0-6162dfb3fe0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d040a3-47e4-4a1f-b2a0-6162dfb3fe0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f503664ea6646ef8e8d09a64be7fe4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:49Z,use_quota=True,user_id='dad11664835a4e649e69652cc4d8b9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:48 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.info Jul 21 19:12:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98494c40-5ef9-4f57-85fb-643faf942f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:48 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98494c40-5ef9-4f57-85fb-643faf942f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175b5377-68d9-405b-8586-9745e9f6d5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:48 devstack cinder-volume[87570]: DEBUG cinder.image.glance [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Creating Keystone auth plugin from conf {{(pid=87570) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:12:49 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.info" returned: 0 in 0.318s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:49 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.info is being set with open permissions: ugo+rw Jul 21 19:12:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:49 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.info Jul 21 19:12:49 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175b5377-68d9-405b-8586-9745e9f6d5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3', 'volume_name': 'volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3', 'volume_size': 1, 'image_id': 'ad9afdee-40b6-45da-8925-d6459f0d3fd8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad9afdee-40b6-45da-8925-d6459f0d3fd8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e341e344c26f5b89690d51ea8c3774e6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f503664ea6646ef8e8d09a64be7fe4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '205889b8ff0d17f5e047ec8d4fd632a33b626758e22bbc673b412c8a1d6f1b10cc47adeff057b8e7d2101b06cfd586d9bd75a3a69482ea19565fe86b1878d11e', 'id': 'ad9afdee-40b6-45da-8925-d6459f0d3fd8', 'created_at': datetime.datetime(2026, 7, 21, 17, 12, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad9afdee-40b6-45da-8925-d6459f0d3fd8/file', 'properties': {}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2b350e-fcff-43ee-a176-6aa6ce2e651a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2b350e-fcff-43ee-a176-6aa6ce2e651a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd27e269-df34-4829-98f0-ac5f0ab52933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:49 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Volume 1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3', 'volume_size': 1, 'image_id': 'ad9afdee-40b6-45da-8925-d6459f0d3fd8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad9afdee-40b6-45da-8925-d6459f0d3fd8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e341e344c26f5b89690d51ea8c3774e6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f503664ea6646ef8e8d09a64be7fe4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '205889b8ff0d17f5e047ec8d4fd632a33b626758e22bbc673b412c8a1d6f1b10cc47adeff057b8e7d2101b06cfd586d9bd75a3a69482ea19565fe86b1878d11e', 'id': 'ad9afdee-40b6-45da-8925-d6459f0d3fd8', 'created_at': datetime.datetime(2026, 7, 21, 17, 12, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad9afdee-40b6-45da-8925-d6459f0d3fd8/file', 'properties': {}}, 'image_service': } Jul 21 19:12:49 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Trying to clone 1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 from image ad9afdee-40b6-45da-8925-d6459f0d3fd8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad9afdee-40b6-45da-8925-d6459f0d3fd8', 'metadata': {}}]). {{(pid=87570) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:12:49 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:12:49 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Image download 0.00 MB at 0.00 MB/s Jul 21 19:12:49 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:49 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed3d6ff-25a4-4d2f-b14c-45e7bc285f46]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.info" returned: 0 in 0.312s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:49 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-3b9f12fb-74b9-4b0a-a53e-7afdb7f03416 tempest-VolumesSnapshotListTestJSON-1313820729 None] Create snapshot completed successfully Jul 21 19:12:49 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD Jul 21 19:12:49 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:49 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:49 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD Jul 21 19:12:49 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:50 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Flow 'volume_create_manager' (6082c449-69f4-48e8-abda-808f9f3e95ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49d6036-2d20-4c1a-9d7c-b479443c5de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Temporary image ad9afdee-40b6-45da-8925-d6459f0d3fd8 is fetched for user dad11664835a4e649e69652cc4d8b9c0. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49d6036-2d20-4c1a-9d7c-b479443c5de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-648106975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f72203-38a1-4449-9da4-019ef2488b57,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6048855fb2c944f681d048582cea2d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:50Z,use_quota=True,user_id='210d431dfae14f95873e1005f7d6c46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fea7b41-3a4a-4f01-8101-e4a151c33d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fea7b41-3a4a-4f01-8101-e4a151c33d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66795fa-a8e6-4b3c-9336-4ffa56c83881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66795fa-a8e6-4b3c-9336-4ffa56c83881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f72203-38a1-4449-9da4-019ef2488b57', 'volume_name': 'volume-49f72203-38a1-4449-9da4-019ef2488b57', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b955db-5712-4c6e-b953-2ae51990ddff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b955db-5712-4c6e-b953-2ae51990ddff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4382b8b0-834e-49d5-8fb6-6960599ab510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:50 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Volume 49f72203-38a1-4449-9da4-019ef2488b57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f72203-38a1-4449-9da4-019ef2488b57', 'volume_size': 1} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-648106975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f72203-38a1-4449-9da4-019ef2488b57,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6048855fb2c944f681d048582cea2d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:50Z,use_quota=True,user_id='210d431dfae14f95873e1005f7d6c46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Creating volume 49f72203-38a1-4449-9da4-019ef2488b57 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:50 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-49f72203-38a1-4449-9da4-019ef2488b57 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:50 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-49f72203-38a1-4449-9da4-019ef2488b57 1073741824 Jul 21 19:12:50 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a230543-5351-4886-8c9a-60195be1e9f9]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:50 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD Jul 21 19:12:50 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-808ac250-f674-4cd0-a234-d03997cdae69 tempest-VolumesSnapshotListTestJSON-1313820729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:50 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:50 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-49f72203-38a1-4449-9da4-019ef2488b57 1073741824" returned: 0 in 0.554s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:50 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD Jul 21 19:12:50 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-49f72203-38a1-4449-9da4-019ef2488b57 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:50 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-49f72203-38a1-4449-9da4-019ef2488b57 Jul 21 19:12:50 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:51 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:51 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD" returned: 1 in 0.393s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-49f72203-38a1-4449-9da4-019ef2488b57" returned: 0 in 0.264s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-808ac250-f674-4cd0-a234-d03997cdae69 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.632s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4382b8b0-834e-49d5-8fb6-6960599ab510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f72203-38a1-4449-9da4-019ef2488b57', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfcb320e-ffbb-4f90-b9eb-0d0eb3247ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-808ac250-f674-4cd0-a234-d03997cdae69 tempest-VolumesSnapshotListTestJSON-1313820729 None] Creating offline snapshot e1d5cd1f-13a8-403b-b04d-39677c2bf05b of volume 6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:12:51 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Volume volume-49f72203-38a1-4449-9da4-019ef2488b57 (49f72203-38a1-4449-9da4-019ef2488b57): created successfully Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfcb320e-ffbb-4f90-b9eb-0d0eb3247ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Flow 'volume_create_manager' (6082c449-69f4-48e8-abda-808f9f3e95ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfca388-f9e8-4aa9-88e7-a3cd68a14bfe]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-808ac250-f674-4cd0-a234-d03997cdae69 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:51 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-2bc6122d-4e13-4df5-bcde-1f0873c63f19 tempest-VolumesGetTest-1453828520 None] Created volume successfully. Jul 21 19:12:51 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e Jul 21 19:12:51 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:51 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-808ac250-f674-4cd0-a234-d03997cdae69 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e" returned: 0 in 0.402s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-808ac250-f674-4cd0-a234-d03997cdae69 tempest-VolumesSnapshotListTestJSON-1313820729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-808ac250-f674-4cd0-a234-d03997cdae69 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:51 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b 1G Jul 21 19:12:51 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:51 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-808ac250-f674-4cd0-a234-d03997cdae69 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b 1G" returned: 0 in 0.426s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-808ac250-f674-4cd0-a234-d03997cdae69 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:52 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b Jul 21 19:12:52 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:52 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-808ac250-f674-4cd0-a234-d03997cdae69 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b" returned: 0 in 0.349s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:52 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-808ac250-f674-4cd0-a234-d03997cdae69 tempest-VolumesSnapshotListTestJSON-1313820729 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b is being set with open permissions: ugo+rw Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-808ac250-f674-4cd0-a234-d03997cdae69 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:52 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b Jul 21 19:12:52 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:52 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-808ac250-f674-4cd0-a234-d03997cdae69 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b" returned: 0 in 0.283s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-808ac250-f674-4cd0-a234-d03997cdae69 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.590s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.598s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f503664ea6646ef8e8d09a64be7fe4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:49Z,use_quota=True,user_id='dad11664835a4e649e69652cc4d8b9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Creating volume 1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:52 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:52 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 1073741824 Jul 21 19:12:52 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:52 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-808ac250-f674-4cd0-a234-d03997cdae69 tempest-VolumesSnapshotListTestJSON-1313820729 None] Create snapshot completed successfully Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Flow 'volume_create_manager' (24cb0cc6-14c4-40f6-bb05-24342be6174c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a4cb8c-8a66-4908-ac5d-1e9737bd6869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a4cb8c-8a66-4908-ac5d-1e9737bd6869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-208840168',display_name='tempest-VolumesGetTest-Volume-1566138055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d284c360-db48-47da-8b3a-e2f9185d491e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6048855fb2c944f681d048582cea2d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:53Z,use_quota=True,user_id='210d431dfae14f95873e1005f7d6c46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918665b5-1b28-4a62-9d50-100bac6648d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918665b5-1b28-4a62-9d50-100bac6648d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e2d79f-47e0-41cc-ab8b-faf78c1aa4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e2d79f-47e0-41cc-ab8b-faf78c1aa4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd284c360-db48-47da-8b3a-e2f9185d491e', 'volume_name': 'volume-d284c360-db48-47da-8b3a-e2f9185d491e', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (676522e8-7b89-4ea4-9bee-f7cf78472994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (676522e8-7b89-4ea4-9bee-f7cf78472994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2699c31-55f0-423d-8d96-818628a14429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:53 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Volume d284c360-db48-47da-8b3a-e2f9185d491e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d284c360-db48-47da-8b3a-e2f9185d491e', 'volume_size': 1} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:53 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 1073741824" returned: 0 in 0.461s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:53 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 Jul 21 19:12:53 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:53 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3" returned: 0 in 0.256s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.401s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-208840168',display_name='tempest-VolumesGetTest-Volume-1566138055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d284c360-db48-47da-8b3a-e2f9185d491e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6048855fb2c944f681d048582cea2d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:53Z,use_quota=True,user_id='210d431dfae14f95873e1005f7d6c46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Creating volume d284c360-db48-47da-8b3a-e2f9185d491e {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:53 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d284c360-db48-47da-8b3a-e2f9185d491e 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:53 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d284c360-db48-47da-8b3a-e2f9185d491e 1073741824 Jul 21 19:12:53 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Attempting download of ad9afdee-40b6-45da-8925-d6459f0d3fd8 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad9afdee-40b6-45da-8925-d6459f0d3fd8', 'metadata': {}}])) to volume 1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[919388db-f661-40f8-bef8-cabdd316af08]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad9afdee-40b6-45da-8925-d6459f0d3fd8_eui3h43m {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:53 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad9afdee-40b6-45da-8925-d6459f0d3fd8_eui3h43m Jul 21 19:12:53 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-675e772b-10ce-464c-9be5-d76f44c418d2 tempest-VolumesSnapshotListTestJSON-1313820729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:53 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad9afdee-40b6-45da-8925-d6459f0d3fd8_eui3h43m" returned: 0 in 0.427s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:53 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad9afdee-40b6-45da-8925-d6459f0d3fd8_eui3h43m {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d284c360-db48-47da-8b3a-e2f9185d491e 1073741824" returned: 0 in 0.544s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d284c360-db48-47da-8b3a-e2f9185d491e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:54 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d284c360-db48-47da-8b3a-e2f9185d491e Jul 21 19:12:54 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:54 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad9afdee-40b6-45da-8925-d6459f0d3fd8_eui3h43m Jul 21 19:12:54 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:54 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d284c360-db48-47da-8b3a-e2f9185d491e" returned: 0 in 0.264s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-675e772b-10ce-464c-9be5-d76f44c418d2 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.532s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2699c31-55f0-423d-8d96-818628a14429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d284c360-db48-47da-8b3a-e2f9185d491e', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de186472-afeb-463e-a1dc-4e222fffe069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-675e772b-10ce-464c-9be5-d76f44c418d2 tempest-VolumesSnapshotListTestJSON-1313820729 None] Creating offline snapshot 56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40 of volume 6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:12:54 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad9afdee-40b6-45da-8925-d6459f0d3fd8_eui3h43m" returned: 1 in 0.385s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad9afdee-40b6-45da-8925-d6459f0d3fd8_eui3h43m' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[faba090d-b27c-43e8-999e-614952d3c7eb]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c98d72-5ca7-4450-82bf-2e01ae63cb95]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-675e772b-10ce-464c-9be5-d76f44c418d2 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:54 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Volume volume-d284c360-db48-47da-8b3a-e2f9185d491e (d284c360-db48-47da-8b3a-e2f9185d491e): created successfully Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de186472-afeb-463e-a1dc-4e222fffe069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Flow 'volume_create_manager' (24cb0cc6-14c4-40f6-bb05-24342be6174c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:54 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-69ff593f-8211-4dd9-b5d9-e9e5579c2e68 tempest-VolumesGetTest-1453828520 None] Created volume successfully. Jul 21 19:12:54 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD Jul 21 19:12:54 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:54 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b Jul 21 19:12:54 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:54 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:54 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-675e772b-10ce-464c-9be5-d76f44c418d2 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b" returned: 0 in 0.470s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-675e772b-10ce-464c-9be5-d76f44c418d2 tempest-VolumesSnapshotListTestJSON-1313820729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:12:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-675e772b-10ce-464c-9be5-d76f44c418d2 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:54 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40 1G Jul 21 19:12:54 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:54 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD Jul 21 19:12:54 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:55 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD" returned: 1 in 0.380s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] ad9afdee-40b6-45da-8925-d6459f0d3fd8 was raw, converting to qcow2 {{(pid=87570) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:55 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 Jul 21 19:12:55 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] Acquiring lock "cinder-d284c360-db48-47da-8b3a-e2f9185d491e-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] Lock "cinder-d284c360-db48-47da-8b3a-e2f9185d491e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] Acquiring lock "cinder-quobyte-d284c360-db48-47da-8b3a-e2f9185d491e" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-d284c360-db48-47da-8b3a-e2f9185d491e" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33b4e97-5b97-49fa-b8d7-0c6db979db91]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d284c360-db48-47da-8b3a-e2f9185d491e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:55 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:55 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d284c360-db48-47da-8b3a-e2f9185d491e Jul 21 19:12:55 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-675e772b-10ce-464c-9be5-d76f44c418d2 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40 1G" returned: 0 in 0.581s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-675e772b-10ce-464c-9be5-d76f44c418d2 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:55 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40 Jul 21 19:12:55 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:55 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3" returned: 0 in 0.542s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad9afdee-40b6-45da-8925-d6459f0d3fd8_erfy3rcpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:12:55 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:55 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 1G Jul 21 19:12:55 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:55 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d284c360-db48-47da-8b3a-e2f9185d491e" returned: 0 in 0.431s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d284c360-db48-47da-8b3a-e2f9185d491e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:55 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:55 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d284c360-db48-47da-8b3a-e2f9185d491e Jul 21 19:12:55 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-675e772b-10ce-464c-9be5-d76f44c418d2 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40" returned: 0 in 0.327s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:55 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-675e772b-10ce-464c-9be5-d76f44c418d2 tempest-VolumesSnapshotListTestJSON-1313820729 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40 is being set with open permissions: ugo+rw Jul 21 19:12:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-675e772b-10ce-464c-9be5-d76f44c418d2 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:55 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40 Jul 21 19:12:55 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:56 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d284c360-db48-47da-8b3a-e2f9185d491e" returned: 0 in 0.262s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:56 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-d284c360-db48-47da-8b3a-e2f9185d491e" released by "delete_volume" :: held 0.740s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 1G" returned: 0 in 0.335s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Downloaded image ad9afdee-40b6-45da-8925-d6459f0d3fd8 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad9afdee-40b6-45da-8925-d6459f0d3fd8', 'metadata': {}}])) to volume 1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 successfully. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Temporary image ad9afdee-40b6-45da-8925-d6459f0d3fd8 for user dad11664835a4e649e69652cc4d8b9c0 is deleted. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Marking volume 1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 as bootable. {{(pid=87570) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:12:56 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-675e772b-10ce-464c-9be5-d76f44c418d2 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40" returned: 0 in 0.274s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Copying metadata from image ad9afdee-40b6-45da-8925-d6459f0d3fd8 to 1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3. {{(pid=87570) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Creating volume glance metadata for volume 1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 backed by image ad9afdee-40b6-45da-8925-d6459f0d3fd8 with: {'image_id': 'ad9afdee-40b6-45da-8925-d6459f0d3fd8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e341e344c26f5b89690d51ea8c3774e6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87570) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-675e772b-10ce-464c-9be5-d76f44c418d2 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.786s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:56 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-675e772b-10ce-464c-9be5-d76f44c418d2 tempest-VolumesSnapshotListTestJSON-1313820729 None] Create snapshot completed successfully Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] Created reservations ['0e5d8d9f-6543-4bab-a417-f19d28934749', '560d43d0-109e-499c-97a5-fa311b45ab30', '2aa53758-bb0b-4968-afc7-da416e60d010', '403064a6-1cd7-42b2-a54f-5126c2eb434d'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd27e269-df34-4829-98f0-ac5f0ab52933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3', 'volume_size': 1, 'image_id': 'ad9afdee-40b6-45da-8925-d6459f0d3fd8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad9afdee-40b6-45da-8925-d6459f0d3fd8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e341e344c26f5b89690d51ea8c3774e6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f503664ea6646ef8e8d09a64be7fe4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '205889b8ff0d17f5e047ec8d4fd632a33b626758e22bbc673b412c8a1d6f1b10cc47adeff057b8e7d2101b06cfd586d9bd75a3a69482ea19565fe86b1878d11e', 'id': 'ad9afdee-40b6-45da-8925-d6459f0d3fd8', 'created_at': datetime.datetime(2026, 7, 21, 17, 12, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 12, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad9afdee-40b6-45da-8925-d6459f0d3fd8/file', 'properties': {}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894067cd-3c7d-4584-9114-b76b99cab949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:56 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Volume volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 (1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3): created successfully Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894067cd-3c7d-4584-9114-b76b99cab949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Flow 'volume_create_manager' (36a64052-2c4f-4131-947f-3ebe80b3410f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:56 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-2a827e50-7182-461c-8a69-974a684630fd tempest-VolumeImageDependencyTests-1835909183 None] Created volume successfully. Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:56 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:56 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] Acquiring lock "cinder-49f72203-38a1-4449-9da4-019ef2488b57-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] Lock "cinder-49f72203-38a1-4449-9da4-019ef2488b57-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:56 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.268s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:56 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] Deleted volume successfully. Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] Acquiring lock "cinder-quobyte-49f72203-38a1-4449-9da4-019ef2488b57" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-befda3c4-522b-48d0-bd13-78e6e6c07822 tempest-VolumesGetTest-1453828520 None] Lock "cinder-d284c360-db48-47da-8b3a-e2f9185d491e-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-49f72203-38a1-4449-9da4-019ef2488b57" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee127e43-4326-44e4-b242-2e1c3ae4cc5f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-49f72203-38a1-4449-9da4-019ef2488b57 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:56 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-49f72203-38a1-4449-9da4-019ef2488b57 Jul 21 19:12:56 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:56 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:56 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:57 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-49f72203-38a1-4449-9da4-019ef2488b57" returned: 0 in 0.428s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-49f72203-38a1-4449-9da4-019ef2488b57 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:57 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-49f72203-38a1-4449-9da4-019ef2488b57 Jul 21 19:12:57 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:57 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.290s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] Acquiring lock "cinder-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:57 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-49f72203-38a1-4449-9da4-019ef2488b57" returned: 0 in 0.314s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] Lock "cinder-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-49f72203-38a1-4449-9da4-019ef2488b57" released by "delete_volume" :: held 0.800s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] Acquiring lock "cinder-quobyte-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] Lock "cinder-quobyte-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] Created reservations ['ce2308db-9551-4433-bab5-b575a1d7d53c', 'b8c7efc2-b55c-4b64-8be5-4e01132e53b0', 'a8d99df7-c72b-4944-9f48-00595854d3e8', 'a85fd3f3-e051-45b8-b510-bee5c8f880c1'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[897b0144-c785-4804-8d92-ce7f7ca36e73]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:57 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:57 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:57 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 Jul 21 19:12:57 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:57 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Acquiring lock "cinder-56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.295s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:57 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] Deleted volume successfully. Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Acquiring lock "cinder-quobyte-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d0125bdc-c216-4799-a8a6-00005814b61b tempest-VolumesGetTest-1453828520 None] Lock "cinder-49f72203-38a1-4449-9da4-019ef2488b57-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-quobyte-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Acquiring lock "cinder-quobyte-56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-quobyte-56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Deleting offline snapshot 56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40 of volume 6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] snapshot_file for this snap is: volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:12:57 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3" returned: 0 in 0.496s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[11485cea-8443-4788-b79e-ce7555043c42]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:58 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3 Jul 21 19:12:58 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:58 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40 Jul 21 19:12:58 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Flow 'volume_create_manager' (aff6c5de-c4bd-43c2-abe4-9d1ef5a931ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:58 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a85f74-20bf-43e7-8122-f67fcfdf9a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3" returned: 0 in 0.321s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a85f74-20bf-43e7-8122-f67fcfdf9a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-165844080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93613b69-63b5-4182-a963-e931d993884b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6048855fb2c944f681d048582cea2d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:58Z,use_quota=True,user_id='210d431dfae14f95873e1005f7d6c46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5349c1f-999f-470d-9ea2-91b317c0e29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5349c1f-999f-470d-9ea2-91b317c0e29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a9ab03-1d43-4c08-ab8f-57af9a5d62f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a9ab03-1d43-4c08-ab8f-57af9a5d62f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93613b69-63b5-4182-a963-e931d993884b', 'volume_name': 'volume-93613b69-63b5-4182-a963-e931d993884b', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d38251-8658-4b29-91f7-df2916239735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d38251-8658-4b29-91f7-df2916239735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5187c3-d457-4e4b-b31d-bf13f4dbbbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:58 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Volume 93613b69-63b5-4182-a963-e931d993884b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93613b69-63b5-4182-a963-e931d993884b', 'volume_size': 1} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-165844080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93613b69-63b5-4182-a963-e931d993884b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6048855fb2c944f681d048582cea2d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:58Z,use_quota=True,user_id='210d431dfae14f95873e1005f7d6c46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Creating volume 93613b69-63b5-4182-a963-e931d993884b {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:58 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:58 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] Lock "cinder-quobyte-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3" released by "delete_volume" :: held 0.935s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40" returned: 0 in 0.397s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:12:58 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b 1073741824 Jul 21 19:12:58 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce4bb9c-cbba-4056-821a-11379a83fa9e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] Created reservations ['933c9ea4-94af-4323-9ab8-6a5de71a6e40', '5424e0bc-f3f5-4ee6-960b-9fa9e55d70d7', '469392f7-ff3f-4200-b538-3b2698e276dd', '884a7e2d-3333-4ec1-b5c9-ab0db8a15cb3'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:58 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b Jul 21 19:12:58 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:58 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:12:58 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:58 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b 1073741824" returned: 0 in 0.484s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:58 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b" returned: 0 in 0.437s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:58 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40 Jul 21 19:12:58 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:58 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.279s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:58 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] Deleted volume successfully. Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:58 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b Jul 21 19:12:58 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ddf1ae53-ecfc-4d33-b200-c53c468317ca tempest-VolumeImageDependencyTests-1835909183 None] Lock "cinder-1d579d47-7ad2-4322-b1ee-4f0ebcce5ed3-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:59 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b" returned: 0 in 0.253s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5187c3-d457-4e4b-b31d-bf13f4dbbbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93613b69-63b5-4182-a963-e931d993884b', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9099871-df14-4b33-98d1-46055679ad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:59 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Volume volume-93613b69-63b5-4182-a963-e931d993884b (93613b69-63b5-4182-a963-e931d993884b): created successfully Jul 21 19:12:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9099871-df14-4b33-98d1-46055679ad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Flow 'volume_create_manager' (aff6c5de-c4bd-43c2-abe4-9d1ef5a931ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:59 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c004ed43-249b-4be5-9397-61d895231de7 tempest-VolumesGetTest-1453828520 None] Created volume successfully. Jul 21 19:12:59 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40" returned: 0 in 0.477s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:59 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40 Jul 21 19:12:59 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:59 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40" returned: 0 in 0.267s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:59 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-quobyte-56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40" released by "_delete_snapshot" :: held 1.713s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:59 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-quobyte-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2" released by "delete_snapshot" :: held 1.742s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:59 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Created reservations ['118937c2-d204-4695-a9b4-dcef9d17fa83', '0ab51fc9-e2bf-4d9a-8a04-f0d04d9f47a8', '1b47f086-f876-4472-b5eb-d7fdb8986953', 'af8e9e82-7e19-447e-820b-e50494f90e34'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:59 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Delete snapshot completed successfully. Jul 21 19:12:59 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3cc3034a-50c3-493b-be7a-c30df3998627 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-56a8ad0f-9a6e-4fa9-a0db-6fa540e2af40-delete_snapshot" released by "delete_snapshot" :: held 1.927s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Acquiring lock "cinder-e1d5cd1f-13a8-403b-b04d-39677c2bf05b-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-e1d5cd1f-13a8-403b-b04d-39677c2bf05b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Acquiring lock "cinder-quobyte-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-quobyte-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Acquiring lock "cinder-quobyte-e1d5cd1f-13a8-403b-b04d-39677c2bf05b" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-quobyte-e1d5cd1f-13a8-403b-b04d-39677c2bf05b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Deleting offline snapshot e1d5cd1f-13a8-403b-b04d-39677c2bf05b of volume 6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] snapshot_file for this snap is: volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d2dec2-8f5b-4502-a02d-3c65650a2dfd]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:00 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b Jul 21 19:13:00 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:00 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b" returned: 0 in 0.410s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf6d880-db26-4366-bf8a-e0ec997210d0]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:00 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e Jul 21 19:13:00 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Flow 'volume_create_manager' (f6ead8cf-8ab1-4e1e-b4d1-a5e23e442895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8995c4-713b-426e-a953-6c4855ef3fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8995c4-713b-426e-a953-6c4855ef3fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-430708910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885e66d2-76f8-4d24-903e-232bcba772f9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6048855fb2c944f681d048582cea2d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=93613b69-63b5-4182-a963-e931d993884b,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:01Z,use_quota=True,user_id='210d431dfae14f95873e1005f7d6c46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47ead9d-2ff5-4775-aece-f5981529159e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47ead9d-2ff5-4775-aece-f5981529159e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b7c645-e059-4582-8176-0ad8c393376b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b7c645-e059-4582-8176-0ad8c393376b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '885e66d2-76f8-4d24-903e-232bcba772f9', 'volume_name': 'volume-885e66d2-76f8-4d24-903e-232bcba772f9', 'volume_size': 1, 'source_volid': '93613b69-63b5-4182-a963-e931d993884b', 'source_volstatus': 'available'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425c86de-674b-49e7-9a57-22b632b29dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425c86de-674b-49e7-9a57-22b632b29dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef06657-a2f8-4f17-9025-0e077537280e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:01 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Volume 885e66d2-76f8-4d24-903e-232bcba772f9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-885e66d2-76f8-4d24-903e-232bcba772f9', 'volume_size': 1, 'source_volid': '93613b69-63b5-4182-a963-e931d993884b', 'source_volstatus': 'available'} Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:01 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Cloning volume 93613b69-63b5-4182-a963-e931d993884b to volume 885e66d2-76f8-4d24-903e-232bcba772f9 Jul 21 19:13:01 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e" returned: 0 in 0.457s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:01 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b Jul 21 19:13:01 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Creating offline snapshot 136cd24f-509a-4987-acc4-436d25eee466 of volume 93613b69-63b5-4182-a963-e931d993884b {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ee0635-cb9d-484d-a504-026cf80c14c0]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:01 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b Jul 21 19:13:01 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:01 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b" returned: 0 in 0.488s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:01 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b Jul 21 19:13:01 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:01 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b" returned: 0 in 0.483s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:01 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466 1G Jul 21 19:13:01 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:01 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.e1d5cd1f-13a8-403b-b04d-39677c2bf05b" returned: 0 in 0.284s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-quobyte-e1d5cd1f-13a8-403b-b04d-39677c2bf05b" released by "_delete_snapshot" :: held 1.776s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-quobyte-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2" released by "delete_snapshot" :: held 1.801s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:01 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Created reservations ['15841e6a-c620-4e35-972d-dd1bf4ae5f96', '04d7f91e-903d-4f83-876b-f9e8d5052dab', '0f58e51b-d145-42bd-8372-e4170f0badad', '67237e1b-06dc-40b2-929a-570ca3686868'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:02 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Delete snapshot completed successfully. Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3c79a986-2181-45f8-95ae-082975df9f1b tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-e1d5cd1f-13a8-403b-b04d-39677c2bf05b-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:02 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466 1G" returned: 0 in 0.536s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93613b69-63b5-4182-a963-e931d993884b -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:02 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93613b69-63b5-4182-a963-e931d993884b -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466 Jul 21 19:13:02 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] Acquiring lock "cinder-a8846b97-5ce9-4b95-bac6-ee5abe19255e-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-a8846b97-5ce9-4b95-bac6-ee5abe19255e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] Acquiring lock "cinder-quobyte-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-quobyte-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] Acquiring lock "cinder-quobyte-a8846b97-5ce9-4b95-bac6-ee5abe19255e" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-quobyte-a8846b97-5ce9-4b95-bac6-ee5abe19255e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] Deleting offline snapshot a8846b97-5ce9-4b95-bac6-ee5abe19255e of volume 6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] snapshot_file for this snap is: volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde7371c-92d5-415d-b519-9b3b6b4084f7]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:02 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93613b69-63b5-4182-a963-e931d993884b -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466" returned: 0 in 0.355s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:02 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466 is being set with open permissions: ugo+rw Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:02 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e Jul 21 19:13:02 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:02 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466 Jul 21 19:13:02 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:02 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466" returned: 0 in 0.275s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:02 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.info Jul 21 19:13:02 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:02 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e" returned: 0 in 0.475s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4461e4-5112-49ce-8873-9af7378479a7]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:03 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 Jul 21 19:13:03 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:03 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.info" returned: 0 in 0.269s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:03 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.info is being set with open permissions: ugo+rw Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:03 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.info Jul 21 19:13:03 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:03 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.info" returned: 0 in 0.263s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:03 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Acquiring lock "cinder-quobyte-885e66d2-76f8-4d24-903e-232bcba772f9" by "_copy_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2" returned: 0 in 0.490s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-885e66d2-76f8-4d24-903e-232bcba772f9" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] snapshot: 136cd24f-509a-4987-acc4-436d25eee466, volume: 885e66d2-76f8-4d24-903e-232bcba772f9, {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:13:03 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e Jul 21 19:13:03 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef4dce4-e5ab-4adb-b3e2-8cc0a211859f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:03 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466 Jul 21 19:13:03 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:03 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e" returned: 0 in 0.437s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:03 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e Jul 21 19:13:03 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:03 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466" returned: 0 in 0.419s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93613b69-63b5-4182-a963-e931d993884b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Creating direct copy from snapshot {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[109006b3-dd75-4036-be9d-3570ac322b22]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:04 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b Jul 21 19:13:04 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:04 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2.a8846b97-5ce9-4b95-bac6-ee5abe19255e" returned: 0 in 0.339s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-quobyte-a8846b97-5ce9-4b95-bac6-ee5abe19255e" released by "_delete_snapshot" :: held 1.907s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-quobyte-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2" released by "delete_snapshot" :: held 1.950s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:04 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] Created reservations ['8a555775-7054-4ef1-99c9-af90cd6e73b3', '746abe0b-03da-4771-bdf1-eec7c8216f1b', 'ae24daf0-3315-4996-b06e-2c1e77e223ae', '6808eff8-6e2e-4e30-abce-30c4236b06d2'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:04 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b" returned: 0 in 0.428s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:04 devstack cinder-volume[87570]: DEBUG cinder.utils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Path /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-885e66d2-76f8-4d24-903e-232bcba772f9 not found in is_blk_device check {{(pid=87570) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:13:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-885e66d2-76f8-4d24-903e-232bcba772f9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:04 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-885e66d2-76f8-4d24-903e-232bcba772f9 Jul 21 19:13:04 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:04 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] Delete snapshot completed successfully. Jul 21 19:13:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-47586890-51ff-4210-8ff8-8861261e869a tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-a8846b97-5ce9-4b95-bac6-ee5abe19255e-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] Acquiring lock "cinder-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] Acquiring lock "cinder-quobyte-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-quobyte-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:04 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[00606373-8ada-450c-bfe6-ba7b33eba856]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:04 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 Jul 21 19:13:04 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:05 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2" returned: 0 in 0.814s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:05 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2 Jul 21 19:13:05 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:06 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2" returned: 0 in 0.792s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-quobyte-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2" released by "delete_volume" :: held 1.713s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:06 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] Created reservations ['c8db7c1e-70b4-4452-a858-b6ae50b11847', '76322d98-e003-4c6e-906f-c6c934e3f35d', '7d7069ff-36b7-4613-9b21-a723e287b854', 'b42553c6-72e9-4fa7-a1f4-1d27d2eb0eda'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:06 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:13:06 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:07 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 1.240s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:07 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:08 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] Deleted volume successfully. Jul 21 19:13:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cdd3b884-aa7b-4569-8a63-3e610a247f71 tempest-VolumesSnapshotListTestJSON-1313820729 None] Lock "cinder-6e88cef5-1d62-46f9-ac36-fd9ef0a2f7a2-delete_volume" released by "delete_volume" :: held 3.463s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:09 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-885e66d2-76f8-4d24-903e-232bcba772f9" returned: 0 in 5.515s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:09 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9e82ea-3530-407b-85bc-fb9d5a1c0c0b]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:10 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b Jul 21 19:13:10 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:10 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b" returned: 0 in 0.658s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:10 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Image conversion details: src /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b, size 1024.00 MB, duration 5.52 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-885e66d2-76f8-4d24-903e-232bcba772f9 {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:13:10 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Converted 1024.00 MB image at 185.65 MB/s Jul 21 19:13:10 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-885e66d2-76f8-4d24-903e-232bcba772f9 is being set with open permissions: ugo+rw Jul 21 19:13:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-885e66d2-76f8-4d24-903e-232bcba772f9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:10 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-885e66d2-76f8-4d24-903e-232bcba772f9 Jul 21 19:13:10 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:10 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-885e66d2-76f8-4d24-903e-232bcba772f9" returned: 0 in 0.278s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-885e66d2-76f8-4d24-903e-232bcba772f9" released by "_copy_volume_from_snapshot" :: held 7.408s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Acquiring lock "cinder-quobyte-136cd24f-509a-4987-acc4-436d25eee466" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-136cd24f-509a-4987-acc4-436d25eee466" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Deleting offline snapshot 136cd24f-509a-4987-acc4-436d25eee466 of volume 93613b69-63b5-4182-a963-e931d993884b {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:13:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] snapshot_file for this snap is: volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:13:10 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[231a3c30-0e54-4413-bb73-f3df24869838]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:11 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466 Jul 21 19:13:11 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:11 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466" returned: 0 in 0.417s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93613b69-63b5-4182-a963-e931d993884b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:13:11 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3bd4a4-c22e-481b-b210-c6b87f50c828]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:11 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b Jul 21 19:13:11 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:11 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b" returned: 0 in 0.452s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:11 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466 Jul 21 19:13:11 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:12 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466" returned: 0 in 0.439s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:12 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466 Jul 21 19:13:12 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:12 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b.136cd24f-509a-4987-acc4-436d25eee466" returned: 0 in 0.285s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-136cd24f-509a-4987-acc4-436d25eee466" released by "_delete_snapshot" :: held 1.724s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.610s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef06657-a2f8-4f17-9025-0e077537280e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-885e66d2-76f8-4d24-903e-232bcba772f9', 'volume_size': 1, 'source_volid': '93613b69-63b5-4182-a963-e931d993884b', 'source_volstatus': 'available'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f9c500-40d3-4c2b-95ae-c64da8c992e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:12 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Volume volume-885e66d2-76f8-4d24-903e-232bcba772f9 (885e66d2-76f8-4d24-903e-232bcba772f9): created successfully Jul 21 19:13:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f9c500-40d3-4c2b-95ae-c64da8c992e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Flow 'volume_create_manager' (f6ead8cf-8ab1-4e1e-b4d1-a5e23e442895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:12 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-87e7d44c-7a92-4402-97b6-ed60428dc6a2 tempest-VolumesGetTest-1453828520 None] Created volume successfully. Jul 21 19:13:12 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Flow 'volume_create_manager' (b39f7a51-4dc0-4573-9577-805762250a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251d7c94-c103-441f-a941-400c201af24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251d7c94-c103-441f-a941-400c201af24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1037057497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58cec5f-bb70-4e11-a24d-a9270bb68b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352a68d8cdb849caa54300fd6ba80672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:13Z,use_quota=True,user_id='a014ea96674f438b99e5fe9f04c66c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20a3002-da17-42ce-a047-ac1140007fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20a3002-da17-42ce-a047-ac1140007fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e745de-ca29-4724-8dce-8c3c00d8cc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e745de-ca29-4724-8dce-8c3c00d8cc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c58cec5f-bb70-4e11-a24d-a9270bb68b46', 'volume_name': 'volume-c58cec5f-bb70-4e11-a24d-a9270bb68b46', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d40a4f12-0755-46b4-8bc2-7d128baa58a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d40a4f12-0755-46b4-8bc2-7d128baa58a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b453f7ec-cf26-448a-bdc9-7f2770b9dc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:13 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Volume c58cec5f-bb70-4e11-a24d-a9270bb68b46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c58cec5f-bb70-4e11-a24d-a9270bb68b46', 'volume_size': 1} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1037057497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58cec5f-bb70-4e11-a24d-a9270bb68b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352a68d8cdb849caa54300fd6ba80672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:13Z,use_quota=True,user_id='a014ea96674f438b99e5fe9f04c66c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Creating volume c58cec5f-bb70-4e11-a24d-a9270bb68b46 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:13 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c58cec5f-bb70-4e11-a24d-a9270bb68b46 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:13 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c58cec5f-bb70-4e11-a24d-a9270bb68b46 1073741824 Jul 21 19:13:13 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:13 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c58cec5f-bb70-4e11-a24d-a9270bb68b46 1073741824" returned: 0 in 0.516s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c58cec5f-bb70-4e11-a24d-a9270bb68b46 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:13 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c58cec5f-bb70-4e11-a24d-a9270bb68b46 Jul 21 19:13:13 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:13 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c58cec5f-bb70-4e11-a24d-a9270bb68b46" returned: 0 in 0.328s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b453f7ec-cf26-448a-bdc9-7f2770b9dc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c58cec5f-bb70-4e11-a24d-a9270bb68b46', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc50656-91ea-4922-8754-8e8d2421b8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:14 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Volume volume-c58cec5f-bb70-4e11-a24d-a9270bb68b46 (c58cec5f-bb70-4e11-a24d-a9270bb68b46): created successfully Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc50656-91ea-4922-8754-8e8d2421b8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Flow 'volume_create_manager' (b39f7a51-4dc0-4573-9577-805762250a45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:14 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-5b484093-c06e-4550-91ba-905ec5f31e70 tempest-ProjectReaderTests-2067636321 None] Created volume successfully. Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Flow 'volume_create_manager' (5e5a1ebe-55c3-443c-af2b-922b57039cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677026d3-b96f-4b27-8bc3-8a240c59cfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677026d3-b96f-4b27-8bc3-8a240c59cfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1169809432',display_name='tempest-VolumesGetTest-Volume-1337204640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6630aee-351f-45dd-9a8e-9066a45c1265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6048855fb2c944f681d048582cea2d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:14Z,use_quota=True,user_id='210d431dfae14f95873e1005f7d6c46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443b000f-8648-47c6-9e8d-6e3056eb31b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443b000f-8648-47c6-9e8d-6e3056eb31b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d185c3-45a5-4711-b221-ab2e0909b339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d185c3-45a5-4711-b221-ab2e0909b339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6630aee-351f-45dd-9a8e-9066a45c1265', 'volume_name': 'volume-b6630aee-351f-45dd-9a8e-9066a45c1265', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8abce1a-47d7-4e80-999e-4936d061ab6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8abce1a-47d7-4e80-999e-4936d061ab6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4906ec73-8822-45e0-b200-1986181306be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:14 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Volume b6630aee-351f-45dd-9a8e-9066a45c1265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6630aee-351f-45dd-9a8e-9066a45c1265', 'volume_size': 1} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1169809432',display_name='tempest-VolumesGetTest-Volume-1337204640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6630aee-351f-45dd-9a8e-9066a45c1265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6048855fb2c944f681d048582cea2d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:14Z,use_quota=True,user_id='210d431dfae14f95873e1005f7d6c46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Creating volume b6630aee-351f-45dd-9a8e-9066a45c1265 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:14 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b6630aee-351f-45dd-9a8e-9066a45c1265 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:14 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b6630aee-351f-45dd-9a8e-9066a45c1265 1073741824 Jul 21 19:13:14 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:14 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b6630aee-351f-45dd-9a8e-9066a45c1265 1073741824" returned: 0 in 0.477s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b6630aee-351f-45dd-9a8e-9066a45c1265 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:14 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b6630aee-351f-45dd-9a8e-9066a45c1265 Jul 21 19:13:14 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:15 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b6630aee-351f-45dd-9a8e-9066a45c1265" returned: 0 in 0.345s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:15 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4906ec73-8822-45e0-b200-1986181306be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6630aee-351f-45dd-9a8e-9066a45c1265', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf5dce1-8f39-438c-adfe-a46ae6ff0524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:15 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Volume volume-b6630aee-351f-45dd-9a8e-9066a45c1265 (b6630aee-351f-45dd-9a8e-9066a45c1265): created successfully Jul 21 19:13:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf5dce1-8f39-438c-adfe-a46ae6ff0524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Flow 'volume_create_manager' (5e5a1ebe-55c3-443c-af2b-922b57039cdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:15 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-982d30fb-e737-4273-89ad-022fd26dd29d tempest-VolumesGetTest-1453828520 None] Created volume successfully. Jul 21 19:13:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] Acquiring lock "cinder-c58cec5f-bb70-4e11-a24d-a9270bb68b46-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] Lock "cinder-c58cec5f-bb70-4e11-a24d-a9270bb68b46-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] Acquiring lock "cinder-quobyte-c58cec5f-bb70-4e11-a24d-a9270bb68b46" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] Lock "cinder-quobyte-c58cec5f-bb70-4e11-a24d-a9270bb68b46" acquired by "delete_volume" :: waited 0.014s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:15 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d5a04c-4c28-4f6d-8708-b7371875698b]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c58cec5f-bb70-4e11-a24d-a9270bb68b46 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:15 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c58cec5f-bb70-4e11-a24d-a9270bb68b46 Jul 21 19:13:15 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:15 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c58cec5f-bb70-4e11-a24d-a9270bb68b46" returned: 0 in 0.399s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c58cec5f-bb70-4e11-a24d-a9270bb68b46 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:15 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c58cec5f-bb70-4e11-a24d-a9270bb68b46 Jul 21 19:13:15 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:16 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c58cec5f-bb70-4e11-a24d-a9270bb68b46" returned: 0 in 0.238s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] Lock "cinder-quobyte-c58cec5f-bb70-4e11-a24d-a9270bb68b46" released by "delete_volume" :: held 0.700s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] Created reservations ['2653a7ab-f1b6-42a3-90fe-78e65040c2ad', 'd7c5232e-332d-4250-a967-d2e89316751a', '4872bc79-b0c4-4f08-9487-ead732f7dcf6', 'fae3cdf0-55cd-45b0-b1a9-5ee3a6219d15'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:16 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:13:16 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] Acquiring lock "cinder-b6630aee-351f-45dd-9a8e-9066a45c1265-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] Lock "cinder-b6630aee-351f-45dd-9a8e-9066a45c1265-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] Acquiring lock "cinder-quobyte-b6630aee-351f-45dd-9a8e-9066a45c1265" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-b6630aee-351f-45dd-9a8e-9066a45c1265" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:16 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.353s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf782a6-7bc9-44d4-b59d-c227214a5646]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b6630aee-351f-45dd-9a8e-9066a45c1265 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:16 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] Deleted volume successfully. Jul 21 19:13:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-56958146-2bc7-4d5f-8b15-b397843d47db tempest-ProjectReaderTests-2067636321 None] Lock "cinder-c58cec5f-bb70-4e11-a24d-a9270bb68b46-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:16 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b6630aee-351f-45dd-9a8e-9066a45c1265 Jul 21 19:13:16 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Flow 'volume_create_manager' (287e407f-e3be-4218-9ba5-409d01428a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8c9983-7761-42dc-8ffb-56cd3440e951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:17 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b6630aee-351f-45dd-9a8e-9066a45c1265" returned: 0 in 0.651s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b6630aee-351f-45dd-9a8e-9066a45c1265 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8c9983-7761-42dc-8ffb-56cd3440e951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384057521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0fba94-b491-44bf-b374-9a6b2fdd35bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352a68d8cdb849caa54300fd6ba80672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:17Z,use_quota=True,user_id='a014ea96674f438b99e5fe9f04c66c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:17 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b6630aee-351f-45dd-9a8e-9066a45c1265 Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f724fc49-16c3-4e48-b659-992f10b0aa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:17 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f724fc49-16c3-4e48-b659-992f10b0aa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fdad00-eb37-47c7-b8f7-f8d354795c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fdad00-eb37-47c7-b8f7-f8d354795c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f0fba94-b491-44bf-b374-9a6b2fdd35bd', 'volume_name': 'volume-4f0fba94-b491-44bf-b374-9a6b2fdd35bd', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d34e487-d223-4c75-916d-d6efd3fa3a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d34e487-d223-4c75-916d-d6efd3fa3a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efe4e1d-12ac-468a-9421-a59e42913ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:17 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Volume 4f0fba94-b491-44bf-b374-9a6b2fdd35bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f0fba94-b491-44bf-b374-9a6b2fdd35bd', 'volume_size': 1} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384057521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0fba94-b491-44bf-b374-9a6b2fdd35bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352a68d8cdb849caa54300fd6ba80672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:17Z,use_quota=True,user_id='a014ea96674f438b99e5fe9f04c66c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Creating volume 4f0fba94-b491-44bf-b374-9a6b2fdd35bd {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:17 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4f0fba94-b491-44bf-b374-9a6b2fdd35bd 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:17 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4f0fba94-b491-44bf-b374-9a6b2fdd35bd 1073741824 Jul 21 19:13:17 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:17 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b6630aee-351f-45dd-9a8e-9066a45c1265" returned: 0 in 0.316s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-b6630aee-351f-45dd-9a8e-9066a45c1265" released by "delete_volume" :: held 1.040s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] Created reservations ['db2a7096-8c12-465e-8bd5-09ab3b3376ae', '98bda54a-a8aa-40ae-a635-87d1b9e138a4', 'e9e7bf8d-abbd-4ead-9528-ee03af6b3b79', '8ad8d6bf-d609-408b-b631-10d74b5c77f3'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:17 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:13:17 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:17 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4f0fba94-b491-44bf-b374-9a6b2fdd35bd 1073741824" returned: 0 in 0.590s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4f0fba94-b491-44bf-b374-9a6b2fdd35bd {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:18 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4f0fba94-b491-44bf-b374-9a6b2fdd35bd Jul 21 19:13:18 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:18 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.283s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:18 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:18 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] Deleted volume successfully. Jul 21 19:13:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-adb57565-894d-408f-b676-45f5d187832a tempest-VolumesGetTest-1453828520 None] Lock "cinder-b6630aee-351f-45dd-9a8e-9066a45c1265-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:18 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4f0fba94-b491-44bf-b374-9a6b2fdd35bd" returned: 0 in 0.310s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efe4e1d-12ac-468a-9421-a59e42913ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f0fba94-b491-44bf-b374-9a6b2fdd35bd', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa6764f-59c0-4e2b-803a-98c096596f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:18 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Volume volume-4f0fba94-b491-44bf-b374-9a6b2fdd35bd (4f0fba94-b491-44bf-b374-9a6b2fdd35bd): created successfully Jul 21 19:13:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa6764f-59c0-4e2b-803a-98c096596f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Flow 'volume_create_manager' (287e407f-e3be-4218-9ba5-409d01428a41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:18 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-13882297-d9b4-4928-9cd5-318a9ec16332 tempest-ProjectReaderTests-2067636321 None] Created volume successfully. Jul 21 19:13:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] Acquiring lock "cinder-885e66d2-76f8-4d24-903e-232bcba772f9-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] Lock "cinder-885e66d2-76f8-4d24-903e-232bcba772f9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] Acquiring lock "cinder-quobyte-885e66d2-76f8-4d24-903e-232bcba772f9" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-885e66d2-76f8-4d24-903e-232bcba772f9" acquired by "delete_volume" :: waited 0.028s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:18 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2479d442-05ca-466b-904f-814800ef4e4a]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-885e66d2-76f8-4d24-903e-232bcba772f9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:19 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-885e66d2-76f8-4d24-903e-232bcba772f9 Jul 21 19:13:19 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] Acquiring lock "cinder-4f0fba94-b491-44bf-b374-9a6b2fdd35bd-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:19 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-885e66d2-76f8-4d24-903e-232bcba772f9" returned: 0 in 0.461s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-885e66d2-76f8-4d24-903e-232bcba772f9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] Lock "cinder-4f0fba94-b491-44bf-b374-9a6b2fdd35bd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:19 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-885e66d2-76f8-4d24-903e-232bcba772f9 Jul 21 19:13:19 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] Acquiring lock "cinder-quobyte-4f0fba94-b491-44bf-b374-9a6b2fdd35bd" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] Lock "cinder-quobyte-4f0fba94-b491-44bf-b374-9a6b2fdd35bd" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[900c7783-cb78-44a8-b014-d80126494e52]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4f0fba94-b491-44bf-b374-9a6b2fdd35bd {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:19 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4f0fba94-b491-44bf-b374-9a6b2fdd35bd Jul 21 19:13:19 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:19 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-885e66d2-76f8-4d24-903e-232bcba772f9" returned: 0 in 0.319s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-885e66d2-76f8-4d24-903e-232bcba772f9" released by "delete_volume" :: held 0.834s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] Created reservations ['494ecf53-a9bf-4b4c-bd62-8896561f1402', 'eaaeaf3b-cdbd-479d-962e-3f3faf967b4a', '5d2ee8c9-6e16-44bb-bc2b-0b0ea6f992e0', '643e8096-1ca4-4ce5-add4-f69875f31049'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:19 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:13:19 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:19 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4f0fba94-b491-44bf-b374-9a6b2fdd35bd" returned: 0 in 0.429s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4f0fba94-b491-44bf-b374-9a6b2fdd35bd {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:19 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4f0fba94-b491-44bf-b374-9a6b2fdd35bd Jul 21 19:13:19 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] Acquiring lock "cinder-93613b69-63b5-4182-a963-e931d993884b-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] Lock "cinder-93613b69-63b5-4182-a963-e931d993884b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:20 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] Acquiring lock "cinder-quobyte-93613b69-63b5-4182-a963-e931d993884b" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.317s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:20 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] Deleted volume successfully. Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-93613b69-63b5-4182-a963-e931d993884b" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a43a78-ec77-451f-ae2d-cd2be84479fa]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-184b23cc-31fc-4f84-9b2e-c61b26b35542 tempest-VolumesGetTest-1453828520 None] Lock "cinder-885e66d2-76f8-4d24-903e-232bcba772f9-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:20 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-4f0fba94-b491-44bf-b374-9a6b2fdd35bd" returned: 0 in 0.421s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] Lock "cinder-quobyte-4f0fba94-b491-44bf-b374-9a6b2fdd35bd" released by "delete_volume" :: held 0.901s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] Created reservations ['bfba4877-c3b4-4d3f-84c6-3d38e385be36', '8e4953d1-4ad7-4c07-8b66-4212878051d3', 'd075169d-5d99-4da0-8e7e-18d69646a6d4', '9de2ebd2-c1c4-4b48-98fe-99fc34591965'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:20 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b Jul 21 19:13:20 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:20 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:13:20 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:20 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b" returned: 0 in 0.501s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:20 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b Jul 21 19:13:20 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:20 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.374s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:20 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] Deleted volume successfully. Jul 21 19:13:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4333e4ea-d631-4b41-af57-4887ee54f9e7 tempest-ProjectReaderTests-2067636321 None] Lock "cinder-4f0fba94-b491-44bf-b374-9a6b2fdd35bd-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:21 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-93613b69-63b5-4182-a963-e931d993884b" returned: 0 in 0.366s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-93613b69-63b5-4182-a963-e931d993884b" released by "delete_volume" :: held 0.936s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Flow 'volume_create_manager' (73823f9d-7ef6-4887-bfe1-3f02e227a16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8162e834-79b6-42d6-9880-e38be676cf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8162e834-79b6-42d6-9880-e38be676cf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2042366828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76cc077e-3128-4478-8252-b4d349d41965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352a68d8cdb849caa54300fd6ba80672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:21Z,use_quota=True,user_id='a014ea96674f438b99e5fe9f04c66c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697812c3-4144-4403-80ae-47c26b96a5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697812c3-4144-4403-80ae-47c26b96a5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961bd97b-3a6d-473a-aef3-7cec50d65aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961bd97b-3a6d-473a-aef3-7cec50d65aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76cc077e-3128-4478-8252-b4d349d41965', 'volume_name': 'volume-76cc077e-3128-4478-8252-b4d349d41965', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be317625-7bad-40bb-ad12-c69c3ff8152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be317625-7bad-40bb-ad12-c69c3ff8152e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9722a69a-e8b0-4784-8bac-3a2185a02734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:21 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Volume 76cc077e-3128-4478-8252-b4d349d41965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76cc077e-3128-4478-8252-b4d349d41965', 'volume_size': 1} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2042366828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76cc077e-3128-4478-8252-b4d349d41965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352a68d8cdb849caa54300fd6ba80672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:21Z,use_quota=True,user_id='a014ea96674f438b99e5fe9f04c66c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Creating volume 76cc077e-3128-4478-8252-b4d349d41965 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:21 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76cc077e-3128-4478-8252-b4d349d41965 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:21 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76cc077e-3128-4478-8252-b4d349d41965 1073741824 Jul 21 19:13:21 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] Created reservations ['9c965af1-753d-4de1-849f-9102b321133a', 'a1fbf3af-ef22-4ce5-80f9-8416be9322e7', '94e0ad15-44da-4380-94c2-3b653d00e175', 'd94b56fc-86d0-4a9e-85b5-39a100892e0e'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:21 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:13:21 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:21 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.295s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:21 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] Deleted volume successfully. Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2dc9af0a-8481-4c73-8c7d-7c871950941e tempest-VolumesGetTest-1453828520 None] Lock "cinder-93613b69-63b5-4182-a963-e931d993884b-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:21 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76cc077e-3128-4478-8252-b4d349d41965 1073741824" returned: 0 in 0.549s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76cc077e-3128-4478-8252-b4d349d41965 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:21 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76cc077e-3128-4478-8252-b4d349d41965 Jul 21 19:13:21 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:22 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76cc077e-3128-4478-8252-b4d349d41965" returned: 0 in 0.275s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9722a69a-e8b0-4784-8bac-3a2185a02734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76cc077e-3128-4478-8252-b4d349d41965', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28d6e56-11d0-4615-bf68-5ab617c27d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:22 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Volume volume-76cc077e-3128-4478-8252-b4d349d41965 (76cc077e-3128-4478-8252-b4d349d41965): created successfully Jul 21 19:13:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28d6e56-11d0-4615-bf68-5ab617c27d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Flow 'volume_create_manager' (73823f9d-7ef6-4887-bfe1-3f02e227a16d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:22 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-62189b7f-f89a-47ee-864b-e3a02dd8fdf5 tempest-ProjectReaderTests-2067636321 None] Created volume successfully. Jul 21 19:13:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] Acquiring lock "cinder-76cc077e-3128-4478-8252-b4d349d41965-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] Lock "cinder-76cc077e-3128-4478-8252-b4d349d41965-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:23 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Flow 'volume_create_manager' (581ee7ff-ba97-4265-9d99-4e51be497e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57eef679-248a-4b83-82e0-afc368e47763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] Acquiring lock "cinder-quobyte-76cc077e-3128-4478-8252-b4d349d41965" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57eef679-248a-4b83-82e0-afc368e47763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1125740253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee91650-1fa6-4fb5-9266-8ccf28da56ee,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6048855fb2c944f681d048582cea2d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:23Z,use_quota=True,user_id='210d431dfae14f95873e1005f7d6c46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806507af-0313-44c9-a478-a959d2843f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806507af-0313-44c9-a478-a959d2843f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1654f29f-64b4-42ca-8a0d-3d8649ccb671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:23 devstack cinder-volume[87570]: DEBUG cinder.image.glance [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Creating Keystone auth plugin from conf {{(pid=87570) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:13:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] Lock "cinder-quobyte-76cc077e-3128-4478-8252-b4d349d41965" acquired by "delete_volume" :: waited 0.058s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:23 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[0346c72c-f326-4572-a197-b13ee8d6511f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76cc077e-3128-4478-8252-b4d349d41965 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:23 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76cc077e-3128-4478-8252-b4d349d41965 Jul 21 19:13:23 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1654f29f-64b4-42ca-8a0d-3d8649ccb671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ee91650-1fa6-4fb5-9266-8ccf28da56ee', 'volume_name': 'volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee', 'volume_size': 1, 'image_id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d5947bfd6bf45059ad4d24acd0d802c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'created_at': datetime.datetime(2026, 7, 21, 16, 54, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9ce555-614a-48c1-89c0-7e97dae82d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9ce555-614a-48c1-89c0-7e97dae82d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3e9341-7fd1-4282-a64d-f21db7675893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:24 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Volume 9ee91650-1fa6-4fb5-9266-8ccf28da56ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee', 'volume_size': 1, 'image_id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d5947bfd6bf45059ad4d24acd0d802c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'created_at': datetime.datetime(2026, 7, 21, 16, 54, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Trying to clone 9ee91650-1fa6-4fb5-9266-8ccf28da56ee from image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}]). {{(pid=87570) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:13:24 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76cc077e-3128-4478-8252-b4d349d41965" returned: 0 in 0.576s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76cc077e-3128-4478-8252-b4d349d41965 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:24 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76cc077e-3128-4478-8252-b4d349d41965 Jul 21 19:13:24 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_s0rtbwlvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:13:24 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Image download 20.69 MB at 20.69 MB/s Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b687c1-a9ac-4b38-9be3-093477afe9f6]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_s0rtbwlvdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:24 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76cc077e-3128-4478-8252-b4d349d41965" returned: 0 in 0.449s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] Lock "cinder-quobyte-76cc077e-3128-4478-8252-b4d349d41965" released by "delete_volume" :: held 1.080s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:24 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_s0rtbwlvdevstack@QuobyteHD Jul 21 19:13:24 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] Created reservations ['02f99ee2-ed9e-4186-a358-579fdcfd7248', 'fd2334a1-2452-4b22-9e90-60e2eafea6ca', '66551fce-6312-466c-aa23-1d6735f4cec7', '7caaad1f-5a00-45e0-b202-e2e6794101b9'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:24 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:13:24 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:25 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_s0rtbwlvdevstack@QuobyteHD" returned: 0 in 0.540s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Temporary image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 is fetched for user 210d431dfae14f95873e1005f7d6c46d. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6239b80-dd71-49ca-8f36-e9803840dc6a]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:25 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_s0rtbwlvdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.284s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:25 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] Deleted volume successfully. Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-43c8d873-78da-4959-8798-c6d229f260ff tempest-ProjectReaderTests-2067636321 None] Lock "cinder-76cc077e-3128-4478-8252-b4d349d41965-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:25 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_s0rtbwlvdevstack@QuobyteHD Jul 21 19:13:25 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:25 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_s0rtbwlvdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1125740253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee91650-1fa6-4fb5-9266-8ccf28da56ee,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6048855fb2c944f681d048582cea2d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:23Z,use_quota=True,user_id='210d431dfae14f95873e1005f7d6c46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Creating volume 9ee91650-1fa6-4fb5-9266-8ccf28da56ee {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:25 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:13:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:25 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee 1073741824 Jul 21 19:13:25 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:26 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee 1073741824" returned: 0 in 0.639s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:26 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee Jul 21 19:13:26 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Flow 'volume_create_manager' (2d9c10bf-c043-486f-8a3b-b68c8caf8118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73073f1e-5a22-4de3-90c3-b6aec7f2d9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73073f1e-5a22-4de3-90c3-b6aec7f2d9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-752766108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013a5f88-3638-4540-adc2-e29048716e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352a68d8cdb849caa54300fd6ba80672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:26Z,use_quota=True,user_id='a014ea96674f438b99e5fe9f04c66c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88725c5b-d375-47bc-97bb-556bf61ea7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88725c5b-d375-47bc-97bb-556bf61ea7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e346461-0f54-4cb2-8b22-589487a8ca48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e346461-0f54-4cb2-8b22-589487a8ca48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '013a5f88-3638-4540-adc2-e29048716e59', 'volume_name': 'volume-013a5f88-3638-4540-adc2-e29048716e59', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2ba529-6618-4206-a4e1-75192383b53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2ba529-6618-4206-a4e1-75192383b53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2b2225-8cbe-4c6d-85b9-a2318c7fd1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:26 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Volume 013a5f88-3638-4540-adc2-e29048716e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-013a5f88-3638-4540-adc2-e29048716e59', 'volume_size': 1} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:26 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee" returned: 0 in 0.341s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.189s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-752766108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013a5f88-3638-4540-adc2-e29048716e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352a68d8cdb849caa54300fd6ba80672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:26Z,use_quota=True,user_id='a014ea96674f438b99e5fe9f04c66c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Creating volume 013a5f88-3638-4540-adc2-e29048716e59 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:26 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-013a5f88-3638-4540-adc2-e29048716e59 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:26 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-013a5f88-3638-4540-adc2-e29048716e59 1073741824 Jul 21 19:13:26 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Attempting download of 2235c2cf-4cba-41d7-9e54-acfbf60b7351 ((None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}])) to volume 9ee91650-1fa6-4fb5-9266-8ccf28da56ee. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[44559f41-9341-4258-8441-a8836e6f38f6]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ov4dpea7 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:26 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ov4dpea7 Jul 21 19:13:26 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:27 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ov4dpea7" returned: 0 in 0.409s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ov4dpea7 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:27 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-013a5f88-3638-4540-adc2-e29048716e59 1073741824" returned: 0 in 0.627s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-013a5f88-3638-4540-adc2-e29048716e59 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:27 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ov4dpea7 Jul 21 19:13:27 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:27 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-013a5f88-3638-4540-adc2-e29048716e59 Jul 21 19:13:27 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:27 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ov4dpea7" returned: 1 in 0.487s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2235c2cf-4cba-41d7-9e54-acfbf60b7351_ov4dpea7' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:13:27 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6bc768-19fa-4351-a164-6dc797a8363a]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_s0rtbwlvdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:27 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-013a5f88-3638-4540-adc2-e29048716e59" returned: 0 in 0.374s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2b2225-8cbe-4c6d-85b9-a2318c7fd1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-013a5f88-3638-4540-adc2-e29048716e59', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61838d07-645c-4cac-8cf6-de8aa871bbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:27 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Volume volume-013a5f88-3638-4540-adc2-e29048716e59 (013a5f88-3638-4540-adc2-e29048716e59): created successfully Jul 21 19:13:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61838d07-645c-4cac-8cf6-de8aa871bbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Flow 'volume_create_manager' (2d9c10bf-c043-486f-8a3b-b68c8caf8118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:27 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-7148850c-0c75-43ee-b124-c54a2df1a088 tempest-ProjectReaderTests-2067636321 None] Created volume successfully. Jul 21 19:13:27 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_s0rtbwlvdevstack@QuobyteHD Jul 21 19:13:27 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:28 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_s0rtbwlvdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:28 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] 2235c2cf-4cba-41d7-9e54-acfbf60b7351 was qcow2, converting to qcow2 {{(pid=87570) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:13:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_s0rtbwlvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:28 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_s0rtbwlvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee Jul 21 19:13:28 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] Acquiring lock "cinder-013a5f88-3638-4540-adc2-e29048716e59-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] Lock "cinder-013a5f88-3638-4540-adc2-e29048716e59-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] Acquiring lock "cinder-quobyte-013a5f88-3638-4540-adc2-e29048716e59" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] Lock "cinder-quobyte-013a5f88-3638-4540-adc2-e29048716e59" acquired by "delete_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:28 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba016b0-51a9-4e95-984d-451259f3b307]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-013a5f88-3638-4540-adc2-e29048716e59 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:28 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-013a5f88-3638-4540-adc2-e29048716e59 Jul 21 19:13:28 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:29 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-013a5f88-3638-4540-adc2-e29048716e59" returned: 0 in 0.539s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-013a5f88-3638-4540-adc2-e29048716e59 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:29 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-013a5f88-3638-4540-adc2-e29048716e59 Jul 21 19:13:29 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:29 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-013a5f88-3638-4540-adc2-e29048716e59" returned: 0 in 0.316s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] Lock "cinder-quobyte-013a5f88-3638-4540-adc2-e29048716e59" released by "delete_volume" :: held 0.907s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:29 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] Created reservations ['8d2a49f8-f1e8-4594-917f-9a0ab26a5980', 'f367a313-47c5-4d1f-98bf-bd95f979280d', 'e1f802ea-29e0-412b-9165-2df4065dcc15', 'b6932bc5-2a68-409e-8ec8-d5f54250439a'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:29 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:29 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:29 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:13:29 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:30 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.313s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:30 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:30 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] Deleted volume successfully. Jul 21 19:13:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ec80cf2-7279-4ad1-81db-b8a5cb078fca tempest-ProjectReaderTests-2067636321 None] Lock "cinder-013a5f88-3638-4540-adc2-e29048716e59-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:30 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_s0rtbwlvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee" returned: 0 in 2.273s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:30 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2235c2cf-4cba-41d7-9e54-acfbf60b7351_s0rtbwlvdevstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:13:30 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Converted 112.00 MB image at 49.23 MB/s Jul 21 19:13:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:30 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee 1G Jul 21 19:13:30 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:30 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee 1G" returned: 0 in 0.377s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:30 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Downloaded image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 ((None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}])) to volume 9ee91650-1fa6-4fb5-9266-8ccf28da56ee successfully. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:13:30 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Temporary image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 for user 210d431dfae14f95873e1005f7d6c46d is deleted. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:13:30 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Marking volume 9ee91650-1fa6-4fb5-9266-8ccf28da56ee as bootable. {{(pid=87570) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:13:30 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Copying metadata from image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 to 9ee91650-1fa6-4fb5-9266-8ccf28da56ee. {{(pid=87570) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:13:30 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Creating volume glance metadata for volume 9ee91650-1fa6-4fb5-9266-8ccf28da56ee backed by image 2235c2cf-4cba-41d7-9e54-acfbf60b7351 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87570) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:13:30 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3e9341-7fd1-4282-a64d-f21db7675893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee', 'volume_size': 1, 'image_id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d5947bfd6bf45059ad4d24acd0d802c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2235c2cf-4cba-41d7-9e54-acfbf60b7351', 'created_at': datetime.datetime(2026, 7, 21, 16, 54, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2235c2cf-4cba-41d7-9e54-acfbf60b7351/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:30 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70475a2b-3647-493d-bd77-f703945340f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:30 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Volume volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee (9ee91650-1fa6-4fb5-9266-8ccf28da56ee): created successfully Jul 21 19:13:30 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70475a2b-3647-493d-bd77-f703945340f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:30 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Flow 'volume_create_manager' (581ee7ff-ba97-4265-9d99-4e51be497e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:30 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-a5aa287d-59bf-4a1a-b67c-6a79387692f7 tempest-VolumesGetTest-1453828520 None] Created volume successfully. Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Flow 'volume_create_manager' (95b0fca6-534f-42bf-9f33-ea30c4bad1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd12213d-ce4b-49a9-a1d3-dae0529c910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd12213d-ce4b-49a9-a1d3-dae0529c910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2030685141',display_name='tempest-VolumesGetTest-Volume-1928203169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6048855fb2c944f681d048582cea2d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:33Z,use_quota=True,user_id='210d431dfae14f95873e1005f7d6c46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d50850-2f45-4637-bb13-c53a4ac5d939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d50850-2f45-4637-bb13-c53a4ac5d939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9273ce0-81d8-4056-a348-5d9a99e9509d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9273ce0-81d8-4056-a348-5d9a99e9509d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403', 'volume_name': 'volume-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf3f7f4-cb42-471d-a036-563c73154796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf3f7f4-cb42-471d-a036-563c73154796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c271da4-e4d4-4f33-809f-107d361d41d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:33 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Volume 66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403', 'volume_size': 1} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2030685141',display_name='tempest-VolumesGetTest-Volume-1928203169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6048855fb2c944f681d048582cea2d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:33Z,use_quota=True,user_id='210d431dfae14f95873e1005f7d6c46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Creating volume 66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:33 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:33 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403 1073741824 Jul 21 19:13:33 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:33 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403 1073741824" returned: 0 in 0.616s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:33 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403 Jul 21 19:13:33 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:34 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403" returned: 0 in 0.275s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c271da4-e4d4-4f33-809f-107d361d41d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d547db-57b8-4503-a3a7-cfbef85b18b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:34 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Volume volume-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403 (66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403): created successfully Jul 21 19:13:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d547db-57b8-4503-a3a7-cfbef85b18b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Flow 'volume_create_manager' (95b0fca6-534f-42bf-9f33-ea30c4bad1b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:34 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-06e72794-b4bf-41c8-8670-2674ac583c16 tempest-VolumesGetTest-1453828520 None] Created volume successfully. Jul 21 19:13:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] Acquiring lock "cinder-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] Lock "cinder-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] Acquiring lock "cinder-quobyte-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:35 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f08d7a4-be70-4ecb-b13b-4abf2fff668c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:35 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403 Jul 21 19:13:35 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:36 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403" returned: 0 in 0.465s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:36 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403 Jul 21 19:13:36 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:36 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403" returned: 0 in 0.305s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403" released by "delete_volume" :: held 0.826s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:36 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] Created reservations ['e147dbfe-4efd-4226-ade8-e07ffdf9e788', 'd8d62430-a6ab-4962-9d1f-340306798c38', '6279fe33-14c6-44d3-8ff3-4d8bccc7d967', '44f06473-c6f5-4273-849e-1d9a77f7ac7c'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:36 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:13:36 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] Acquiring lock "cinder-9ee91650-1fa6-4fb5-9266-8ccf28da56ee-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] Lock "cinder-9ee91650-1fa6-4fb5-9266-8ccf28da56ee-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] Acquiring lock "cinder-quobyte-9ee91650-1fa6-4fb5-9266-8ccf28da56ee" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-9ee91650-1fa6-4fb5-9266-8ccf28da56ee" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:36 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecaf649-12eb-4a4c-8760-b5f2664aac49]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:37 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.421s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:37 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:37 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] Deleted volume successfully. Jul 21 19:13:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7967711d-31a5-4f4f-aed6-0beffe657490 tempest-VolumesGetTest-1453828520 None] Lock "cinder-66cf2dca-9dbd-4f9c-a28a-7e3cc6d51403-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:37 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee Jul 21 19:13:37 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:37 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee" returned: 0 in 0.436s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:37 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee Jul 21 19:13:37 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:37 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9ee91650-1fa6-4fb5-9266-8ccf28da56ee" returned: 0 in 0.303s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] Lock "cinder-quobyte-9ee91650-1fa6-4fb5-9266-8ccf28da56ee" released by "delete_volume" :: held 0.825s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:37 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] Created reservations ['40308e2f-5827-4101-9970-027fcb679385', '9163c460-4945-4f9d-a684-8c0df4f2700e', '0b204b46-e81b-455e-a666-541ca18426fa', '5f5e6cc6-3b2c-458f-a892-bb6d061928b3'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:37 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:13:37 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:38 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.406s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:38 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:38 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] Deleted volume successfully. Jul 21 19:13:38 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8e3e8dd0-6928-4fd9-8e59-d29ae29413df tempest-VolumesGetTest-1453828520 None] Lock "cinder-9ee91650-1fa6-4fb5-9266-8ccf28da56ee-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:47 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=193,cinder:SELECT=161,cinder:INSERT=52,cinder:DELETE=18 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:13:48 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=136,cinder:INSERT=67,cinder:UPDATE=211,cinder:DELETE=16 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:13:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:13:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:56 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:13:56 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:57 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.413s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:13:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:13:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:14:02 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Flow 'volume_create_manager' (b1c220f5-04c0-4a75-aee2-7062ede58ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d1d9b5-d1d0-4411-b152-23e465979edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d1d9b5-d1d0-4411-b152-23e465979edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1700353633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457acac1-155b-4f9a-837a-08026c809a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dca62500d564a999698c0c5f6920ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:03Z,use_quota=True,user_id='00df79db5de24f9db651cbea5f29c112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9938e607-b320-4bd1-aeca-ee43a71b7f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9938e607-b320-4bd1-aeca-ee43a71b7f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc7fa565-05ac-4512-ae51-55d9e93166e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc7fa565-05ac-4512-ae51-55d9e93166e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '457acac1-155b-4f9a-837a-08026c809a5c', 'volume_name': 'volume-457acac1-155b-4f9a-837a-08026c809a5c', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6200e6cb-6de9-4ece-aba0-173f72d1b3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6200e6cb-6de9-4ece-aba0-173f72d1b3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47702bd3-fa91-41a3-be06-25ba6612274d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:03 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Volume 457acac1-155b-4f9a-837a-08026c809a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-457acac1-155b-4f9a-837a-08026c809a5c', 'volume_size': 1} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1700353633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457acac1-155b-4f9a-837a-08026c809a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dca62500d564a999698c0c5f6920ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:03Z,use_quota=True,user_id='00df79db5de24f9db651cbea5f29c112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Creating volume 457acac1-155b-4f9a-837a-08026c809a5c {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:03 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:03 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c 1073741824 Jul 21 19:14:03 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:03 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c 1073741824" returned: 0 in 0.684s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:03 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c Jul 21 19:14:03 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:04 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c" returned: 0 in 0.325s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:14:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47702bd3-fa91-41a3-be06-25ba6612274d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-457acac1-155b-4f9a-837a-08026c809a5c', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d22784-dcb5-4f2c-82a2-205df1149e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:04 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Volume volume-457acac1-155b-4f9a-837a-08026c809a5c (457acac1-155b-4f9a-837a-08026c809a5c): created successfully Jul 21 19:14:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d22784-dcb5-4f2c-82a2-205df1149e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Flow 'volume_create_manager' (b1c220f5-04c0-4a75-aee2-7062ede58ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:04 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0f895f28-23fb-48cd-95e7-d5c2d3096267 tempest-SnapshotDependencyTests-1725581720 None] Created volume successfully. Jul 21 19:14:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] Creating offline snapshot 57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 of volume 457acac1-155b-4f9a-837a-08026c809a5c {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:14:05 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[57426a68-7789-45e1-8257-53dcc53f742a]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:05 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c Jul 21 19:14:05 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:06 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c" returned: 0 in 0.877s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:06 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 1G Jul 21 19:14:06 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:07 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 1G" returned: 0 in 0.901s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-457acac1-155b-4f9a-837a-08026c809a5c -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:07 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-457acac1-155b-4f9a-837a-08026c809a5c -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 Jul 21 19:14:07 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:07 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-457acac1-155b-4f9a-837a-08026c809a5c -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770" returned: 0 in 0.428s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:07 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 is being set with open permissions: ugo+rw Jul 21 19:14:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:07 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 Jul 21 19:14:07 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:07 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770" returned: 0 in 0.319s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:08 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.info Jul 21 19:14:08 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:08 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.info" returned: 0 in 0.371s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:08 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.info is being set with open permissions: ugo+rw Jul 21 19:14:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:08 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.info Jul 21 19:14:08 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:08 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.info" returned: 0 in 0.537s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.584s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:09 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-2d098c62-dc5b-4be3-9927-b02a48c4a964 tempest-SnapshotDependencyTests-1725581720 None] Create snapshot completed successfully Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Flow 'volume_create_manager' (957b4e44-7ff6-4da9-8104-de4182629f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9722242a-b9dd-4ca1-bce5-1b34b62925ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9722242a-b9dd-4ca1-bce5-1b34b62925ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193ccd9d-5c80-470d-bc18-ceda0e1fb4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dca62500d564a999698c0c5f6920ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=57f66a9e-4f11-44e1-9b2e-7e3f4e70a770,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:11Z,use_quota=True,user_id='00df79db5de24f9db651cbea5f29c112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421db2d3-2a23-42f3-9e6f-367ffe4d33d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421db2d3-2a23-42f3-9e6f-367ffe4d33d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c226c716-3380-4646-83de-d17c97cf5d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c226c716-3380-4646-83de-d17c97cf5d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '193ccd9d-5c80-470d-bc18-ceda0e1fb4e7', 'volume_name': 'volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7', 'volume_size': 1, 'snapshot_id': '57f66a9e-4f11-44e1-9b2e-7e3f4e70a770'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98fa908-a3a8-4619-abbc-1f44d9a264cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98fa908-a3a8-4619-abbc-1f44d9a264cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066aec55-6a7c-473c-8c42-0b55b805568e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:10 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Volume 193ccd9d-5c80-470d-bc18-ceda0e1fb4e7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7', 'volume_size': 1, 'snapshot_id': '57f66a9e-4f11-44e1-9b2e-7e3f4e70a770'} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Acquiring lock "cinder-quobyte-57f66a9e-4f11-44e1-9b2e-7e3f4e70a770-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7" by "_create_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-quobyte-57f66a9e-4f11-44e1-9b2e-7e3f4e70a770-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Creating volume 193ccd9d-5c80-470d-bc18-ceda0e1fb4e7 from snapshot 57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 {{(pid=87570) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Acquiring lock "cinder-quobyte-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7" by "_copy_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-quobyte-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] snapshot: 57f66a9e-4f11-44e1-9b2e-7e3f4e70a770, volume: 193ccd9d-5c80-470d-bc18-ceda0e1fb4e7, {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:14:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:11 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbc0f32-9bb4-4182-9be8-e8a15b7d9d30]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:11 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 Jul 21 19:14:11 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:11 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770" returned: 0 in 0.642s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-457acac1-155b-4f9a-837a-08026c809a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:14:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Creating direct copy from snapshot {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:14:11 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02fe9b1-0d4f-4d5d-91a3-814b0f09e85b]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:12 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c Jul 21 19:14:12 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:12 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c" returned: 0 in 0.585s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:12 devstack cinder-volume[87570]: DEBUG cinder.utils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Path /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7 not found in is_blk_device check {{(pid=87570) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:14:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:12 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7 Jul 21 19:14:12 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:20 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7" returned: 0 in 7.788s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[d242f092-9504-4d8b-af4a-929157df1475]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:20 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c Jul 21 19:14:20 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Flow 'volume_create_manager' (1cd33943-dddf-4ce3-b4e3-314680d296a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3e405b-d8bd-4a4b-8a3f-ee34ffebbe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3e405b-d8bd-4a4b-8a3f-ee34ffebbe61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1274968330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7406765b-5dff-4ae2-b928-c3287bb4540f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e4238bf56b4da7997ce8f1ec431f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:21Z,use_quota=True,user_id='d3fbdacc4264459991be97ffbef06a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cf70634-9e36-45df-a184-31df6b37c62d),volume_type_id=4cf70634-9e36-45df-a184-31df6b37c62d)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee14d171-1f52-450f-acba-d95336bd292e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee14d171-1f52-450f-acba-d95336bd292e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725b0139-f5f8-40ff-9639-bf700b060e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725b0139-f5f8-40ff-9639-bf700b060e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7406765b-5dff-4ae2-b928-c3287bb4540f', 'volume_name': 'volume-7406765b-5dff-4ae2-b928-c3287bb4540f', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee368d6f-e59c-4613-af53-88414b32734f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee368d6f-e59c-4613-af53-88414b32734f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a50eb4f-d09f-4c11-bd65-c280cbcb16da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:20 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Volume 7406765b-5dff-4ae2-b928-c3287bb4540f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7406765b-5dff-4ae2-b928-c3287bb4540f', 'volume_size': 1} Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:20 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c" returned: 0 in 0.675s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Image conversion details: src /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c, size 1024.00 MB, duration 7.79 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7 {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:14:20 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Converted 1024.00 MB image at 131.47 MB/s Jul 21 19:14:20 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7 is being set with open permissions: ugo+rw Jul 21 19:14:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:20 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7 Jul 21 19:14:20 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Flow 'volume_create_manager' (8574c7c3-05b2-4326-8190-ac723ca6f5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df8164d-37d2-4e7b-8bd3-cc24a2a9e567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df8164d-37d2-4e7b-8bd3-cc24a2a9e567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-633812722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40a6f87-ca81-4d2d-ad8f-8b2711657c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e4238bf56b4da7997ce8f1ec431f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:21Z,use_quota=True,user_id='d3fbdacc4264459991be97ffbef06a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89e43ce7-2b15-4392-b31f-793a0ac3b4de),volume_type_id=89e43ce7-2b15-4392-b31f-793a0ac3b4de)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:21 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec071ef7-a9bf-42bc-b2bb-8b55b85fddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec071ef7-a9bf-42bc-b2bb-8b55b85fddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c21dba-ce05-46c4-ade7-40d9615d820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c21dba-ce05-46c4-ade7-40d9615d820c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b40a6f87-ca81-4d2d-ad8f-8b2711657c0a', 'volume_name': 'volume-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491f0607-46f0-47df-b935-c9cb12c21cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491f0607-46f0-47df-b935-c9cb12c21cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2763fe2-62fd-43e1-b464-4b6d5bb27dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:21 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Volume b40a6f87-ca81-4d2d-ad8f-8b2711657c0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a', 'volume_size': 1} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7" returned: 0 in 0.451s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-quobyte-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7" released by "_copy_volume_from_snapshot" :: held 10.353s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-quobyte-57f66a9e-4f11-44e1-9b2e-7e3f4e70a770-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7" released by "_create_volume_from_snapshot" :: held 10.412s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.449s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1274968330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7406765b-5dff-4ae2-b928-c3287bb4540f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e4238bf56b4da7997ce8f1ec431f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:21Z,use_quota=True,user_id='d3fbdacc4264459991be97ffbef06a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cf70634-9e36-45df-a184-31df6b37c62d),volume_type_id=4cf70634-9e36-45df-a184-31df6b37c62d)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Creating volume 7406765b-5dff-4ae2-b928-c3287bb4540f {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:21 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7406765b-5dff-4ae2-b928-c3287bb4540f 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:21 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7406765b-5dff-4ae2-b928-c3287bb4540f 1073741824 Jul 21 19:14:21 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066aec55-6a7c-473c-8c42-0b55b805568e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7', 'volume_size': 1, 'snapshot_id': '57f66a9e-4f11-44e1-9b2e-7e3f4e70a770'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4bce82-9dde-44f9-82ee-67eda082d608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:21 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Volume volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7 (193ccd9d-5c80-470d-bc18-ceda0e1fb4e7): created successfully Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4bce82-9dde-44f9-82ee-67eda082d608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Flow 'volume_create_manager' (957b4e44-7ff6-4da9-8104-de4182629f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:21 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-d9db0c5c-0494-4bb3-9d24-0b51eb181c56 tempest-SnapshotDependencyTests-1725581720 None] Created volume successfully. Jul 21 19:14:21 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7406765b-5dff-4ae2-b928-c3287bb4540f 1073741824" returned: 0 in 0.534s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Flow 'volume_create_manager' (6607ac20-8d6c-4419-8f22-d03597743dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:21 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d71d2fd-4e79-4c9c-a05e-2a92fc161e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d71d2fd-4e79-4c9c-a05e-2a92fc161e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1728967140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5979b6-72a0-42c8-a890-48d5fc3df888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e4238bf56b4da7997ce8f1ec431f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:22Z,use_quota=True,user_id='d3fbdacc4264459991be97ffbef06a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8f33883-800e-4b99-98e8-0074ec55b42f),volume_type_id=a8f33883-800e-4b99-98e8-0074ec55b42f)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e366c1ac-84dd-4bd3-ad66-8d01fda28ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e366c1ac-84dd-4bd3-ad66-8d01fda28ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af1ff67-fbc9-425d-bc60-4ea2186e5c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.image.glance [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Creating Keystone auth plugin from conf {{(pid=87570) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7406765b-5dff-4ae2-b928-c3287bb4540f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:22 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7406765b-5dff-4ae2-b928-c3287bb4540f Jul 21 19:14:22 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af1ff67-fbc9-425d-bc60-4ea2186e5c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a5979b6-72a0-42c8-a890-48d5fc3df888', 'volume_name': 'volume-3a5979b6-72a0-42c8-a890-48d5fc3df888', 'volume_size': 1, 'image_id': '00a9c59a-a51e-41b0-bb41-d7be1f8e5c22', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00a9c59a-a51e-41b0-bb41-d7be1f8e5c22', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--671861167', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e4238bf56b4da7997ce8f1ec431f20', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00a9c59a-a51e-41b0-bb41-d7be1f8e5c22', 'created_at': datetime.datetime(2026, 7, 21, 17, 14, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 14, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00a9c59a-a51e-41b0-bb41-d7be1f8e5c22/file', 'properties': {}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (443ecb54-3a29-444b-8704-bf56cfba6888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:22 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (443ecb54-3a29-444b-8704-bf56cfba6888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d3ff33-fdae-4c7a-ab53-1c9bbcca6992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:22 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Volume 3a5979b6-72a0-42c8-a890-48d5fc3df888: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a5979b6-72a0-42c8-a890-48d5fc3df888', 'volume_size': 1, 'image_id': '00a9c59a-a51e-41b0-bb41-d7be1f8e5c22', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00a9c59a-a51e-41b0-bb41-d7be1f8e5c22', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--671861167', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e4238bf56b4da7997ce8f1ec431f20', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00a9c59a-a51e-41b0-bb41-d7be1f8e5c22', 'created_at': datetime.datetime(2026, 7, 21, 17, 14, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 14, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00a9c59a-a51e-41b0-bb41-d7be1f8e5c22/file', 'properties': {}}, 'image_service': } Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Trying to clone 3a5979b6-72a0-42c8-a890-48d5fc3df888 from image 00a9c59a-a51e-41b0-bb41-d7be1f8e5c22 at location (None, [{'url': 'file:///opt/stack/data/glance/images/00a9c59a-a51e-41b0-bb41-d7be1f8e5c22', 'metadata': {}}]). {{(pid=87570) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7406765b-5dff-4ae2-b928-c3287bb4540f" returned: 0 in 0.263s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.938s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-633812722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40a6f87-ca81-4d2d-ad8f-8b2711657c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e4238bf56b4da7997ce8f1ec431f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:21Z,use_quota=True,user_id='d3fbdacc4264459991be97ffbef06a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89e43ce7-2b15-4392-b31f-793a0ac3b4de),volume_type_id=89e43ce7-2b15-4392-b31f-793a0ac3b4de)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Creating volume b40a6f87-ca81-4d2d-ad8f-8b2711657c0a {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:22 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a50eb4f-d09f-4c11-bd65-c280cbcb16da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7406765b-5dff-4ae2-b928-c3287bb4540f', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:22 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a 1073741824 Jul 21 19:14:22 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87d0f16-2eee-4f59-943b-66a27d3b8c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:22 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Volume volume-7406765b-5dff-4ae2-b928-c3287bb4540f (7406765b-5dff-4ae2-b928-c3287bb4540f): created successfully Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87d0f16-2eee-4f59-943b-66a27d3b8c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Flow 'volume_create_manager' (1cd33943-dddf-4ce3-b4e3-314680d296a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:22 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-6a9ba842-0976-4a93-8c30-b8d3692d3fa1 tempest-TestInstancesWithCinderVolumes-2090654795 None] Created volume successfully. Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] Acquiring lock "cinder-57f66a9e-4f11-44e1-9b2e-7e3f4e70a770-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-57f66a9e-4f11-44e1-9b2e-7e3f4e70a770-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] Acquiring lock "cinder-quobyte-457acac1-155b-4f9a-837a-08026c809a5c" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-quobyte-457acac1-155b-4f9a-837a-08026c809a5c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] Acquiring lock "cinder-quobyte-57f66a9e-4f11-44e1-9b2e-7e3f4e70a770" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-quobyte-57f66a9e-4f11-44e1-9b2e-7e3f4e70a770" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] Deleting offline snapshot 57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 of volume 457acac1-155b-4f9a-837a-08026c809a5c {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] snapshot_file for this snap is: volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd7d5b3-d687-47db-8391-736c4a19ddbc]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:22 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 Jul 21 19:14:22 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:22 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a 1073741824" returned: 0 in 0.635s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:23 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a Jul 21 19:14:23 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:23 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770" returned: 0 in 0.429s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-457acac1-155b-4f9a-837a-08026c809a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:23 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8acc4b8-4cbe-4d91-9332-f60315e01a7a]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:23 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a" returned: 0 in 0.310s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:14:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2763fe2-62fd-43e1-b464-4b6d5bb27dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32dd3c8-2524-4337-8b52-0736cb33d83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:23 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c Jul 21 19:14:23 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:23 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Volume volume-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a (b40a6f87-ca81-4d2d-ad8f-8b2711657c0a): created successfully Jul 21 19:14:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32dd3c8-2524-4337-8b52-0736cb33d83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Flow 'volume_create_manager' (8574c7c3-05b2-4326-8190-ac723ca6f5c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:23 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-3d7f59f7-8804-4d65-a76f-435bc8cfe720 tempest-TestInstancesWithCinderVolumes-2090654795 None] Created volume successfully. Jul 21 19:14:23 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c" returned: 0 in 0.427s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:23 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 Jul 21 19:14:23 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:23 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770" returned: 0 in 0.374s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:24 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770 Jul 21 19:14:24 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:24 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c.57f66a9e-4f11-44e1-9b2e-7e3f4e70a770" returned: 0 in 0.255s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-quobyte-57f66a9e-4f11-44e1-9b2e-7e3f4e70a770" released by "_delete_snapshot" :: held 1.598s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-quobyte-457acac1-155b-4f9a-837a-08026c809a5c" released by "delete_snapshot" :: held 1.625s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:24 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] Created reservations ['63ef7bfd-027b-4a4c-a09f-0f53ec8dae89', 'a8f43a67-aa2c-41ff-9702-40115ebf6e25', '2de8de98-5b30-4b38-9957-759f8d6157af', '66603be6-553a-4f86-a0e6-7d66450399ce'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:24 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] Delete snapshot completed successfully. Jul 21 19:14:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0d33c81b-84c3-4db5-ab00-eb14cbf940ec tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-57f66a9e-4f11-44e1-9b2e-7e3f4e70a770-delete_snapshot" released by "delete_snapshot" :: held 1.851s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] Acquiring lock "cinder-457acac1-155b-4f9a-837a-08026c809a5c-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-457acac1-155b-4f9a-837a-08026c809a5c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] Acquiring lock "cinder-quobyte-457acac1-155b-4f9a-837a-08026c809a5c" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-quobyte-457acac1-155b-4f9a-837a-08026c809a5c" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:24 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ac5352-3d4f-403b-b85a-84fe255e88c8]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:25 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c Jul 21 19:14:25 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:25 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c" returned: 0 in 0.400s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:25 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c Jul 21 19:14:25 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:25 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-457acac1-155b-4f9a-837a-08026c809a5c" returned: 0 in 0.248s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-quobyte-457acac1-155b-4f9a-837a-08026c809a5c" released by "delete_volume" :: held 0.713s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:25 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] Created reservations ['325f21a4-0cc8-4e6f-9dfc-7172fb02de04', '67405b83-53fc-4a01-a4e5-737581246ea2', '0d99cfb7-8358-4511-afd7-58531fab8c99', 'ecf92670-64d5-455a-8ae9-e7bbc06a5fe3'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:25 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:14:25 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] Acquiring lock "cinder-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:26 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.328s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:26 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] Deleted volume successfully. Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] Acquiring lock "cinder-quobyte-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-quobyte-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7" acquired by "delete_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-98d76658-b063-4a9d-833f-dd53e0290392 tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-457acac1-155b-4f9a-837a-08026c809a5c-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d552f4-4fe3-4883-af5a-8f5d6fce26aa]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:26 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7 Jul 21 19:14:26 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_h3g7hwzqdevstack@QuobyteHD, size 20.69 MB, duration 4.02 sec {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:14:26 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Image download 20.69 MB at 5.14 MB/s Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57eaf81-04f5-46c3-a3a1-8a893e7e7222]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_h3g7hwzqdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:26 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_h3g7hwzqdevstack@QuobyteHD Jul 21 19:14:26 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:26 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7" returned: 0 in 0.413s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:26 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7 Jul 21 19:14:26 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:26 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_h3g7hwzqdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Temporary image 00a9c59a-a51e-41b0-bb41-d7be1f8e5c22 is fetched for user d3fbdacc4264459991be97ffbef06a18. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c579f6-c453-4517-b1fd-a4aa5feea59b]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_h3g7hwzqdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:26 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7" returned: 0 in 0.283s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-quobyte-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7" released by "delete_volume" :: held 0.746s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:26 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_h3g7hwzqdevstack@QuobyteHD Jul 21 19:14:26 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] Created reservations ['201ddabd-a636-4bd1-b178-096ff41f1516', 'f037bae2-86ae-4571-9c95-394886eed7d5', '6bf33855-8cbd-46d3-9b44-9a364581980d', '408959d1-e89e-4ee5-9b86-0e800ce44b2f'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:27 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:14:27 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:27 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_h3g7hwzqdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1728967140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5979b6-72a0-42c8-a890-48d5fc3df888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e4238bf56b4da7997ce8f1ec431f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:22Z,use_quota=True,user_id='d3fbdacc4264459991be97ffbef06a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8f33883-800e-4b99-98e8-0074ec55b42f),volume_type_id=a8f33883-800e-4b99-98e8-0074ec55b42f)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Creating volume 3a5979b6-72a0-42c8-a890-48d5fc3df888 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:27 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:14:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:27 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888 1073741824 Jul 21 19:14:27 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:27 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.300s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:27 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:27 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] Deleted volume successfully. Jul 21 19:14:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-05ee9a8b-19c6-4002-81d1-6072e215d6c6 tempest-SnapshotDependencyTests-1725581720 None] Lock "cinder-193ccd9d-5c80-470d-bc18-ceda0e1fb4e7-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:27 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888 1073741824" returned: 0 in 0.559s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:27 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888 Jul 21 19:14:27 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:28 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888" returned: 0 in 0.286s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:14:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:28 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Attempting download of 00a9c59a-a51e-41b0-bb41-d7be1f8e5c22 ((None, [{'url': 'file:///opt/stack/data/glance/images/00a9c59a-a51e-41b0-bb41-d7be1f8e5c22', 'metadata': {}}])) to volume 3a5979b6-72a0-42c8-a890-48d5fc3df888. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:14:28 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dcc846-bac0-41ed-9f5e-ab298d36e47c]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_epcftzss {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:28 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_epcftzss Jul 21 19:14:28 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:28 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_epcftzss" returned: 0 in 0.436s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_epcftzss {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:28 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_epcftzss Jul 21 19:14:28 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:28 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_epcftzss" returned: 1 in 0.385s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_epcftzss' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:14:28 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[195baa13-eea6-436a-8ffd-449919c9bbbc]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_h3g7hwzqdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:29 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_h3g7hwzqdevstack@QuobyteHD Jul 21 19:14:29 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:29 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_h3g7hwzqdevstack@QuobyteHD" returned: 0 in 0.546s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:29 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] 00a9c59a-a51e-41b0-bb41-d7be1f8e5c22 was qcow2, converting to qcow2 {{(pid=87570) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:14:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_h3g7hwzqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:29 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_h3g7hwzqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888 Jul 21 19:14:29 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:31 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_h3g7hwzqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888" returned: 0 in 2.218s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:31 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_00a9c59a-a51e-41b0-bb41-d7be1f8e5c22_h3g7hwzqdevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888 {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:14:31 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Converted 112.00 MB image at 50.46 MB/s Jul 21 19:14:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:31 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888 1G Jul 21 19:14:31 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:32 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888 1G" returned: 0 in 0.445s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:32 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Downloaded image 00a9c59a-a51e-41b0-bb41-d7be1f8e5c22 ((None, [{'url': 'file:///opt/stack/data/glance/images/00a9c59a-a51e-41b0-bb41-d7be1f8e5c22', 'metadata': {}}])) to volume 3a5979b6-72a0-42c8-a890-48d5fc3df888 successfully. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:14:32 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Temporary image 00a9c59a-a51e-41b0-bb41-d7be1f8e5c22 for user d3fbdacc4264459991be97ffbef06a18 is deleted. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:14:32 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Marking volume 3a5979b6-72a0-42c8-a890-48d5fc3df888 as bootable. {{(pid=87570) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:14:32 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Copying metadata from image 00a9c59a-a51e-41b0-bb41-d7be1f8e5c22 to 3a5979b6-72a0-42c8-a890-48d5fc3df888. {{(pid=87570) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:14:32 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Creating volume glance metadata for volume 3a5979b6-72a0-42c8-a890-48d5fc3df888 backed by image 00a9c59a-a51e-41b0-bb41-d7be1f8e5c22 with: {'image_id': '00a9c59a-a51e-41b0-bb41-d7be1f8e5c22', 'image_name': 'tempest-scenario-img--671861167', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87570) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:14:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d3ff33-fdae-4c7a-ab53-1c9bbcca6992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5979b6-72a0-42c8-a890-48d5fc3df888', 'volume_size': 1, 'image_id': '00a9c59a-a51e-41b0-bb41-d7be1f8e5c22', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00a9c59a-a51e-41b0-bb41-d7be1f8e5c22', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--671861167', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e4238bf56b4da7997ce8f1ec431f20', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00a9c59a-a51e-41b0-bb41-d7be1f8e5c22', 'created_at': datetime.datetime(2026, 7, 21, 17, 14, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 14, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00a9c59a-a51e-41b0-bb41-d7be1f8e5c22/file', 'properties': {}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba84a37-3507-443b-85bd-96ad4fd2a39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:32 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Volume volume-3a5979b6-72a0-42c8-a890-48d5fc3df888 (3a5979b6-72a0-42c8-a890-48d5fc3df888): created successfully Jul 21 19:14:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba84a37-3507-443b-85bd-96ad4fd2a39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Flow 'volume_create_manager' (6607ac20-8d6c-4419-8f22-d03597743dbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:32 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f9cec698-d2f4-407d-b418-cda75bcfd92a tempest-TestInstancesWithCinderVolumes-2090654795 None] Created volume successfully. Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Flow 'volume_create_manager' (46b18f98-d633-4acf-a1bd-5c2a889e1e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5185cc7d-0b02-426c-b70d-f065451ccb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5185cc7d-0b02-426c-b70d-f065451ccb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-57493226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ecde041-ef51-44d7-8f3a-d5f0fc144078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d042d0a4dec04512ad83f78a65e68dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:33Z,use_quota=True,user_id='81a743ce5fed4d6596fd5ff47465d55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fba631b-60c3-4854-b6c5-03e425a6a10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fba631b-60c3-4854-b6c5-03e425a6a10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5420c3-2c04-4c95-9deb-f0a585848abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5420c3-2c04-4c95-9deb-f0a585848abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ecde041-ef51-44d7-8f3a-d5f0fc144078', 'volume_name': 'volume-1ecde041-ef51-44d7-8f3a-d5f0fc144078', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455a63d7-6649-48a9-b5e6-ab3b314abf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455a63d7-6649-48a9-b5e6-ab3b314abf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6861141b-21f0-4d25-950a-1714cdd1fb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:33 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Volume 1ecde041-ef51-44d7-8f3a-d5f0fc144078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ecde041-ef51-44d7-8f3a-d5f0fc144078', 'volume_size': 1} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-57493226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ecde041-ef51-44d7-8f3a-d5f0fc144078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d042d0a4dec04512ad83f78a65e68dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:33Z,use_quota=True,user_id='81a743ce5fed4d6596fd5ff47465d55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Creating volume 1ecde041-ef51-44d7-8f3a-d5f0fc144078 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:33 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1ecde041-ef51-44d7-8f3a-d5f0fc144078 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:33 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1ecde041-ef51-44d7-8f3a-d5f0fc144078 1073741824 Jul 21 19:14:33 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:33 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1ecde041-ef51-44d7-8f3a-d5f0fc144078 1073741824" returned: 0 in 0.609s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1ecde041-ef51-44d7-8f3a-d5f0fc144078 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:33 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1ecde041-ef51-44d7-8f3a-d5f0fc144078 Jul 21 19:14:33 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:34 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1ecde041-ef51-44d7-8f3a-d5f0fc144078" returned: 0 in 0.347s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:14:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6861141b-21f0-4d25-950a-1714cdd1fb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ecde041-ef51-44d7-8f3a-d5f0fc144078', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301fab06-adc0-420b-a334-05f482c55807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:34 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Volume volume-1ecde041-ef51-44d7-8f3a-d5f0fc144078 (1ecde041-ef51-44d7-8f3a-d5f0fc144078): created successfully Jul 21 19:14:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301fab06-adc0-420b-a334-05f482c55807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Flow 'volume_create_manager' (46b18f98-d633-4acf-a1bd-5c2a889e1e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:34 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-bf853103-6d43-4e44-8769-ac58c576e48b tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Created volume successfully. Jul 21 19:14:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-d876db9b-da4e-41e2-9fde-872e0d52504a req-e6af7374-54cd-46d5-9ad7-04272cea061d tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-d876db9b-da4e-41e2-9fde-872e0d52504a req-e6af7374-54cd-46d5-9ad7-04272cea061d tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-d876db9b-da4e-41e2-9fde-872e0d52504a req-e6af7374-54cd-46d5-9ad7-04272cea061d tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-d876db9b-da4e-41e2-9fde-872e0d52504a req-e6af7374-54cd-46d5-9ad7-04272cea061d tempest-TestInstancesWithCinderVolumes-2090654795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-3a5979b6-72a0-42c8-a890-48d5fc3df888', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11471927-b7eb-44aa-a73b-77fa600ee862', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:14:36 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-d876db9b-da4e-41e2-9fde-872e0d52504a req-e6af7374-54cd-46d5-9ad7-04272cea061d tempest-TestInstancesWithCinderVolumes-2090654795 None] attachment_update completed successfully. Jul 21 19:14:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-c99cba64-c57d-4898-b9d1-60c3b860b016 req-c7bf58ef-b883-4e37-9977-4fed7b8eb1d4 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-c99cba64-c57d-4898-b9d1-60c3b860b016 req-c7bf58ef-b883-4e37-9977-4fed7b8eb1d4 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-c99cba64-c57d-4898-b9d1-60c3b860b016 req-c7bf58ef-b883-4e37-9977-4fed7b8eb1d4 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-c99cba64-c57d-4898-b9d1-60c3b860b016 req-c7bf58ef-b883-4e37-9977-4fed7b8eb1d4 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-1ecde041-ef51-44d7-8f3a-d5f0fc144078', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '375eb5ad-a2e2-453b-a143-6f02f4907e2d', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:14:36 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-c99cba64-c57d-4898-b9d1-60c3b860b016 req-c7bf58ef-b883-4e37-9977-4fed7b8eb1d4 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] attachment_update completed successfully. Jul 21 19:14:41 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-8147fa99-1f0a-49b0-840c-3081f9bbf4c9 req-e0888054-ce4a-47ee-98fa-c31b2a6f4ed9 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Terminate volume connection completed successfully. Jul 21 19:14:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-8147fa99-1f0a-49b0-840c-3081f9bbf4c9 req-e0888054-ce4a-47ee-98fa-c31b2a6f4ed9 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Deleting attachment 375eb5ad-a2e2-453b-a143-6f02f4907e2d. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:14:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Acquiring lock "cinder-1ecde041-ef51-44d7-8f3a-d5f0fc144078-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Lock "cinder-1ecde041-ef51-44d7-8f3a-d5f0fc144078-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Acquiring lock "cinder-quobyte-1ecde041-ef51-44d7-8f3a-d5f0fc144078" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Lock "cinder-quobyte-1ecde041-ef51-44d7-8f3a-d5f0fc144078" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:42 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[f388f146-3721-4261-b065-6c070eca7985]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1ecde041-ef51-44d7-8f3a-d5f0fc144078 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:42 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1ecde041-ef51-44d7-8f3a-d5f0fc144078 Jul 21 19:14:42 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:42 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1ecde041-ef51-44d7-8f3a-d5f0fc144078" returned: 0 in 0.461s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1ecde041-ef51-44d7-8f3a-d5f0fc144078 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:42 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1ecde041-ef51-44d7-8f3a-d5f0fc144078 Jul 21 19:14:42 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:42 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1ecde041-ef51-44d7-8f3a-d5f0fc144078" returned: 0 in 0.244s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Lock "cinder-quobyte-1ecde041-ef51-44d7-8f3a-d5f0fc144078" released by "delete_volume" :: held 0.751s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:42 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Created reservations ['dcfee698-67b3-4fe7-a5e8-c1e1baa8c5d3', 'f1627e71-1a8c-4f74-af8f-412bd579bf17', '0fc6ba79-1f2b-4558-97b1-daabbba7331e', '7e80d666-705f-49fd-adc0-7d179ec9db19'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:42 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:14:42 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:43 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.341s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:43 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:43 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Deleted volume successfully. Jul 21 19:14:43 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4187fea8-7148-4b35-ab61-77e061086a29 tempest-TestServerVolumeAttachScenarioOldVersion-1564797573 None] Lock "cinder-1ecde041-ef51-44d7-8f3a-d5f0fc144078-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:14:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:56 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:14:56 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:57 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.278s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:14:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:14:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:14:57 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=58,cinder:SELECT=50,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:14:57 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=63,cinder:UPDATE=48,cinder:DELETE=6,cinder:INSERT=13 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:15:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-0e3f4a5b-8119-4e7b-b9bb-cb21bdcd3798 req-55079fdd-7d41-4e9f-8dd5-a576b5d8816d tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-0e3f4a5b-8119-4e7b-b9bb-cb21bdcd3798 req-55079fdd-7d41-4e9f-8dd5-a576b5d8816d tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-0e3f4a5b-8119-4e7b-b9bb-cb21bdcd3798 req-55079fdd-7d41-4e9f-8dd5-a576b5d8816d tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-0e3f4a5b-8119-4e7b-b9bb-cb21bdcd3798 req-55079fdd-7d41-4e9f-8dd5-a576b5d8816d tempest-TestInstancesWithCinderVolumes-2090654795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-7406765b-5dff-4ae2-b928-c3287bb4540f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09fc4de9-bea2-4634-a205-5ad1b716445f', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:15:12 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-0e3f4a5b-8119-4e7b-b9bb-cb21bdcd3798 req-55079fdd-7d41-4e9f-8dd5-a576b5d8816d tempest-TestInstancesWithCinderVolumes-2090654795 None] attachment_update completed successfully. Jul 21 19:15:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-dfad9eff-a4da-4e2f-a1df-95c7b36f7352 req-98682870-b41a-405a-a741-2698b4773cf2 tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-dfad9eff-a4da-4e2f-a1df-95c7b36f7352 req-98682870-b41a-405a-a741-2698b4773cf2 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-dfad9eff-a4da-4e2f-a1df-95c7b36f7352 req-98682870-b41a-405a-a741-2698b4773cf2 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-dfad9eff-a4da-4e2f-a1df-95c7b36f7352 req-98682870-b41a-405a-a741-2698b4773cf2 tempest-TestInstancesWithCinderVolumes-2090654795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebee494c-c91a-415a-b2aa-f56a3f5d7000', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:15:14 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-dfad9eff-a4da-4e2f-a1df-95c7b36f7352 req-98682870-b41a-405a-a741-2698b4773cf2 tempest-TestInstancesWithCinderVolumes-2090654795 None] attachment_update completed successfully. Jul 21 19:15:20 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-08197929-833b-4482-b50e-61efe71cc929 req-77776992-192a-48a7-b761-51c59c3a01ca tempest-TestInstancesWithCinderVolumes-2090654795 None] Terminate volume connection completed successfully. Jul 21 19:15:20 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-08197929-833b-4482-b50e-61efe71cc929 req-77776992-192a-48a7-b761-51c59c3a01ca tempest-TestInstancesWithCinderVolumes-2090654795 None] Deleting attachment 09fc4de9-bea2-4634-a205-5ad1b716445f. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:15:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "cinder-7406765b-5dff-4ae2-b928-c3287bb4540f-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "cinder-7406765b-5dff-4ae2-b928-c3287bb4540f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "cinder-quobyte-7406765b-5dff-4ae2-b928-c3287bb4540f" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "cinder-quobyte-7406765b-5dff-4ae2-b928-c3287bb4540f" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:21 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[52782ca4-162e-43e5-864a-a0673df3598c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7406765b-5dff-4ae2-b928-c3287bb4540f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:21 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7406765b-5dff-4ae2-b928-c3287bb4540f Jul 21 19:15:21 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:21 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7406765b-5dff-4ae2-b928-c3287bb4540f" returned: 0 in 0.477s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7406765b-5dff-4ae2-b928-c3287bb4540f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:21 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7406765b-5dff-4ae2-b928-c3287bb4540f Jul 21 19:15:21 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:21 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7406765b-5dff-4ae2-b928-c3287bb4540f" returned: 0 in 0.288s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "cinder-quobyte-7406765b-5dff-4ae2-b928-c3287bb4540f" released by "delete_volume" :: held 0.811s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:21 devstack cinder-volume[87570]: WARNING cinder.quota [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1793458204-1020161367 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1793458204-1020161367, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:15:21 devstack cinder-volume[87570]: WARNING cinder.quota [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1793458204-1020161367 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1793458204-1020161367, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:15:21 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Created reservations ['430f2323-e7c0-485b-8371-5604518a3f94', 'f2c8c316-add0-46f8-a785-4b996e7b70bb', '4b5533b3-5d20-4f8c-87a3-a66cc17349a0', '5452ead0-520c-4f53-8e1f-8cebccc757d0'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:15:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:21 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:21 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:15:22 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:22 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.269s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:15:22 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Deleted volume successfully. Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f873e525-417d-42f0-ba7e-9af0001f295c tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "cinder-7406765b-5dff-4ae2-b928-c3287bb4540f-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Flow 'volume_create_manager' (7b340c34-69ed-4e28-91b1-8cb6b6797455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed80e38-a68d-4ffe-88e4-25eca67fb254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed80e38-a68d-4ffe-88e4-25eca67fb254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2057257944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f1d030-39e9-4399-bb44-cc8b45cdf1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f32621a8394f0cb29b8bdfdd614952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:23Z,use_quota=True,user_id='6d5823790c7a438f8d467ca297e7bca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747d70b9-2c1f-4469-978f-e76b4e5a497b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747d70b9-2c1f-4469-978f-e76b4e5a497b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0468ab9-a452-4783-a861-75d57ad5ee79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0468ab9-a452-4783-a861-75d57ad5ee79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f1d030-39e9-4399-bb44-cc8b45cdf1c0', 'volume_name': 'volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ee2a57-d28a-4491-af50-1742db5a73cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ee2a57-d28a-4491-af50-1742db5a73cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be53af70-fc06-40d8-9246-32bfff06744f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:22 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Volume c3f1d030-39e9-4399-bb44-cc8b45cdf1c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0', 'volume_size': 1} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2057257944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f1d030-39e9-4399-bb44-cc8b45cdf1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f32621a8394f0cb29b8bdfdd614952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:23Z,use_quota=True,user_id='6d5823790c7a438f8d467ca297e7bca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Creating volume c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:15:22 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:15:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:22 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 1073741824 Jul 21 19:15:22 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:23 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 1073741824" returned: 0 in 0.500s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:23 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 Jul 21 19:15:23 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:23 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0" returned: 0 in 0.298s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:15:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be53af70-fc06-40d8-9246-32bfff06744f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01407e63-a4ee-401c-aaaa-56a2f565efe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:23 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Volume volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 (c3f1d030-39e9-4399-bb44-cc8b45cdf1c0): created successfully Jul 21 19:15:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01407e63-a4ee-401c-aaaa-56a2f565efe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Flow 'volume_create_manager' (7b340c34-69ed-4e28-91b1-8cb6b6797455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:23 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-032115dd-e88c-49ba-a235-27dfb286ca9b tempest-TestStampPattern-1751917379 None] Created volume successfully. Jul 21 19:15:25 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-cd9eab8a-9c37-40de-95c1-cc0bf537d327 req-a9deb8c3-da35-494a-af79-9f2442ee2898 tempest-TestInstancesWithCinderVolumes-2090654795 None] Terminate volume connection completed successfully. Jul 21 19:15:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-cd9eab8a-9c37-40de-95c1-cc0bf537d327 req-a9deb8c3-da35-494a-af79-9f2442ee2898 tempest-TestInstancesWithCinderVolumes-2090654795 None] Deleting attachment ebee494c-c91a-415a-b2aa-f56a3f5d7000. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:15:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "cinder-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "cinder-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "cinder-quobyte-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "cinder-quobyte-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:25 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d00727-3e23-4792-8faf-1a2034f453a0]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:26 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a Jul 21 19:15:26 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:26 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a" returned: 0 in 0.403s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:26 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a Jul 21 19:15:26 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:26 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a" returned: 0 in 0.290s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "cinder-quobyte-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a" released by "delete_volume" :: held 0.749s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:26 devstack cinder-volume[87570]: WARNING cinder.quota [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-176453272-1372505856 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-176453272-1372505856, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:15:26 devstack cinder-volume[87570]: WARNING cinder.quota [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-176453272-1372505856 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-176453272-1372505856, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:15:26 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Created reservations ['29af5dce-f923-45f4-8c6e-bd8a55a58dde', '915fcc7a-8044-4932-9551-384d11455239', '8646db27-5dda-48c1-b3eb-0edf84b3fb51', '398af16a-9372-4c89-b632-de81adba17fd'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:15:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:26 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:15:26 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:27 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.387s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:27 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:15:27 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Deleted volume successfully. Jul 21 19:15:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88e0a998-c592-43d0-8d51-8a9caccc2aa6 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "cinder-b40a6f87-ca81-4d2d-ad8f-8b2711657c0a-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:31 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-6fded929-33a6-4076-bc80-1a172c5147f7 req-c74a7ba8-4762-4bae-8945-d7e1e1327a91 tempest-TestInstancesWithCinderVolumes-2090654795 None] Terminate volume connection completed successfully. Jul 21 19:15:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-6fded929-33a6-4076-bc80-1a172c5147f7 req-c74a7ba8-4762-4bae-8945-d7e1e1327a91 tempest-TestInstancesWithCinderVolumes-2090654795 None] Deleting attachment 11471927-b7eb-44aa-a73b-77fa600ee862. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:15:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "cinder-3a5979b6-72a0-42c8-a890-48d5fc3df888-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "cinder-3a5979b6-72a0-42c8-a890-48d5fc3df888-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "cinder-quobyte-3a5979b6-72a0-42c8-a890-48d5fc3df888" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "cinder-quobyte-3a5979b6-72a0-42c8-a890-48d5fc3df888" acquired by "delete_volume" :: waited 0.034s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:32 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7a530b-6c5d-4f08-8cb5-82bd8cc01839]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:32 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888 Jul 21 19:15:32 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:32 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888" returned: 0 in 0.594s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:32 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888 Jul 21 19:15:32 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:33 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3a5979b6-72a0-42c8-a890-48d5fc3df888" returned: 0 in 0.410s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "cinder-quobyte-3a5979b6-72a0-42c8-a890-48d5fc3df888" released by "delete_volume" :: held 1.075s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:33 devstack cinder-volume[87570]: WARNING cinder.quota [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1274771899-512534669 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1274771899-512534669, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:15:33 devstack cinder-volume[87570]: WARNING cinder.quota [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1274771899-512534669 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1274771899-512534669, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:15:33 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Created reservations ['29836240-af09-446e-bac4-fb800a9f0eaf', 'a81ac28b-bba2-4108-bbea-d6c31b5e34a6', 'd977327d-b0ce-49c8-9a98-e1a1523c15b9', '421c8864-bbe5-4a1f-9951-0eaeda08fb29'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:15:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:33 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:15:33 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:33 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.340s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:33 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:15:33 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Deleted volume successfully. Jul 21 19:15:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f0e3be70-ceef-4fcd-952e-2f5bba220308 tempest-TestInstancesWithCinderVolumes-2090654795 None] Lock "cinder-3a5979b6-72a0-42c8-a890-48d5fc3df888-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:43 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=33,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:15:43 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=33,cinder:UPDATE=35,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Flow 'volume_create_manager' (2f78c952-bd74-4b4a-ba41-c24fc632bfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a24107-e2af-4ddc-b2a4-eb04034032c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a24107-e2af-4ddc-b2a4-eb04034032c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-470000490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4d3de3-b793-4c7f-bfd4-8d421ff04987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e0aea4ba074b2c90fcb3c91cad1084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:49Z,use_quota=True,user_id='aba8ef12c7884a05bb6390fbefa36ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80127c82-8dd2-4143-9e7f-f94551e37f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80127c82-8dd2-4143-9e7f-f94551e37f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e40c6e-ff66-4f80-b5e6-784a133fa0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e40c6e-ff66-4f80-b5e6-784a133fa0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc4d3de3-b793-4c7f-bfd4-8d421ff04987', 'volume_name': 'volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88472a71-4690-41bf-92c5-11f514791542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88472a71-4690-41bf-92c5-11f514791542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c346d1b0-35d5-4104-a1e2-e8a6f9341902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:49 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume bc4d3de3-b793-4c7f-bfd4-8d421ff04987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987', 'volume_size': 1} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-470000490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4d3de3-b793-4c7f-bfd4-8d421ff04987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e0aea4ba074b2c90fcb3c91cad1084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:49Z,use_quota=True,user_id='aba8ef12c7884a05bb6390fbefa36ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Creating volume bc4d3de3-b793-4c7f-bfd4-8d421ff04987 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:15:49 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:49 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987 1073741824 Jul 21 19:15:49 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:49 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987 1073741824" returned: 0 in 0.509s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:49 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987 Jul 21 19:15:49 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:49 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987" returned: 0 in 0.275s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:15:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c346d1b0-35d5-4104-a1e2-e8a6f9341902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568dda63-f217-4088-bf63-64e298295c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:50 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987 (bc4d3de3-b793-4c7f-bfd4-8d421ff04987): created successfully Jul 21 19:15:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568dda63-f217-4088-bf63-64e298295c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Flow 'volume_create_manager' (2f78c952-bd74-4b4a-ba41-c24fc632bfcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:50 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-b6101b24-5eaf-4863-bf26-da11a45a9621 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Created volume successfully. Jul 21 19:15:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Creating offline snapshot 51b085b8-3268-4861-937a-3541eeea0d7d of volume bc4d3de3-b793-4c7f-bfd4-8d421ff04987 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:15:51 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c0efb6-f569-410a-bed0-66bbea2308a9]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:51 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987 Jul 21 19:15:51 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:51 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987" returned: 0 in 0.377s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:51 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d 1G Jul 21 19:15:51 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:52 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d 1G" returned: 0 in 0.424s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:52 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d Jul 21 19:15:52 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:52 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d" returned: 0 in 0.318s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:52 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d is being set with open permissions: ugo+rw Jul 21 19:15:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:52 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d Jul 21 19:15:52 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:52 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d" returned: 0 in 0.273s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:52 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.info Jul 21 19:15:52 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:53 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.info" returned: 0 in 0.278s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:53 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.info is being set with open permissions: ugo+rw Jul 21 19:15:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:53 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.info Jul 21 19:15:53 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:53 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.info" returned: 0 in 0.267s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.034s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:53 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-7f1c2d63-635e-4b1e-bc55-38ed3b157a48 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Create snapshot completed successfully Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Flow 'volume_create_manager' (98f9627b-5991-4987-a695-c02e0797dd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e391ce40-97aa-4f89-a631-3104fd8c66ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e391ce40-97aa-4f89-a631-3104fd8c66ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1990268440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a857a27-17e2-4e75-b911-ea57e55873e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e0aea4ba074b2c90fcb3c91cad1084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:55Z,use_quota=True,user_id='aba8ef12c7884a05bb6390fbefa36ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ea19cc-dc4f-493f-851e-65b4d5b2219e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ea19cc-dc4f-493f-851e-65b4d5b2219e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89324e1d-60c7-4e42-8270-16ac7f402df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89324e1d-60c7-4e42-8270-16ac7f402df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a857a27-17e2-4e75-b911-ea57e55873e7', 'volume_name': 'volume-6a857a27-17e2-4e75-b911-ea57e55873e7', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c152d38f-9654-4be5-8eff-994bef8230ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c152d38f-9654-4be5-8eff-994bef8230ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed89d57-1461-470a-b10f-8342820f6410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:55 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume 6a857a27-17e2-4e75-b911-ea57e55873e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a857a27-17e2-4e75-b911-ea57e55873e7', 'volume_size': 1} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1990268440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a857a27-17e2-4e75-b911-ea57e55873e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e0aea4ba074b2c90fcb3c91cad1084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:55Z,use_quota=True,user_id='aba8ef12c7884a05bb6390fbefa36ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Creating volume 6a857a27-17e2-4e75-b911-ea57e55873e7 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:15:55 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6a857a27-17e2-4e75-b911-ea57e55873e7 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:55 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6a857a27-17e2-4e75-b911-ea57e55873e7 1073741824 Jul 21 19:15:55 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Flow 'volume_create_manager' (ce49c5e5-b71e-416f-b69a-493802fb8027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9f599d-f762-4b96-b5cb-1811df0e8c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9f599d-f762-4b96-b5cb-1811df0e8c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1418354301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b09718-4165-4237-b616-786d4e72579c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e0aea4ba074b2c90fcb3c91cad1084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:55Z,use_quota=True,user_id='aba8ef12c7884a05bb6390fbefa36ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faffd04f-6950-464c-a3e6-c92b68f70f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faffd04f-6950-464c-a3e6-c92b68f70f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bf4cb9-8f9b-4e6d-b902-25004ceb49dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bf4cb9-8f9b-4e6d-b902-25004ceb49dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b09718-4165-4237-b616-786d4e72579c', 'volume_name': 'volume-08b09718-4165-4237-b616-786d4e72579c', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b601375-4127-450a-ac4c-f64ebca62d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b601375-4127-450a-ac4c-f64ebca62d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67585c0-b02c-4981-af79-3af349e98099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:55 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume 08b09718-4165-4237-b616-786d4e72579c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b09718-4165-4237-b616-786d4e72579c', 'volume_size': 1} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:55 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6a857a27-17e2-4e75-b911-ea57e55873e7 1073741824" returned: 0 in 0.566s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6a857a27-17e2-4e75-b911-ea57e55873e7 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:55 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6a857a27-17e2-4e75-b911-ea57e55873e7 Jul 21 19:15:55 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Flow 'volume_create_manager' (a010b893-39ae-409e-ba94-3533c55c5583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76a9fee-1826-430c-86ed-9722b36f092d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76a9fee-1826-430c-86ed-9722b36f092d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1213271921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab8797a-59b6-40c5-bb12-f15cc572f650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e0aea4ba074b2c90fcb3c91cad1084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:56Z,use_quota=True,user_id='aba8ef12c7884a05bb6390fbefa36ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7030c716-1fe0-4a00-b877-42e806476cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7030c716-1fe0-4a00-b877-42e806476cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08962b86-f5b1-40d4-b358-3dc6abdd286d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08962b86-f5b1-40d4-b358-3dc6abdd286d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ab8797a-59b6-40c5-bb12-f15cc572f650', 'volume_name': 'volume-3ab8797a-59b6-40c5-bb12-f15cc572f650', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff8fcba-43d7-4125-a6cc-b650a8902f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff8fcba-43d7-4125-a6cc-b650a8902f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77830884-d3ba-4074-9479-7a8de4fb51ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:56 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume 3ab8797a-59b6-40c5-bb12-f15cc572f650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ab8797a-59b6-40c5-bb12-f15cc572f650', 'volume_size': 1} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:56 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6a857a27-17e2-4e75-b911-ea57e55873e7" returned: 0 in 0.367s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.511s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1418354301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b09718-4165-4237-b616-786d4e72579c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e0aea4ba074b2c90fcb3c91cad1084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:55Z,use_quota=True,user_id='aba8ef12c7884a05bb6390fbefa36ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Creating volume 08b09718-4165-4237-b616-786d4e72579c {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:15:56 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-08b09718-4165-4237-b616-786d4e72579c 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:56 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-08b09718-4165-4237-b616-786d4e72579c 1073741824 Jul 21 19:15:56 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed89d57-1461-470a-b10f-8342820f6410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a857a27-17e2-4e75-b911-ea57e55873e7', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b8c6b30-e32c-4819-b46c-309185934eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:56 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume volume-6a857a27-17e2-4e75-b911-ea57e55873e7 (6a857a27-17e2-4e75-b911-ea57e55873e7): created successfully Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b8c6b30-e32c-4819-b46c-309185934eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Flow 'volume_create_manager' (98f9627b-5991-4987-a695-c02e0797dd76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:56 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-e551cd37-edf4-458c-ac35-6f99925b1e47 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Created volume successfully. Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Flow 'volume_create_manager' (768db76c-8bd2-46f8-9fd1-1bc19afd8d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e82cfd4-1568-4d5a-b532-a2d6b2d98560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e82cfd4-1568-4d5a-b532-a2d6b2d98560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1657757194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1301ae43-887b-429f-bc7f-2a92c7309ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e0aea4ba074b2c90fcb3c91cad1084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:56Z,use_quota=True,user_id='aba8ef12c7884a05bb6390fbefa36ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a22caf5-a59e-4493-abf5-de6f400f02e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a22caf5-a59e-4493-abf5-de6f400f02e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97750705-80a3-4d7d-bba9-ca5e0d6cedec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97750705-80a3-4d7d-bba9-ca5e0d6cedec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1301ae43-887b-429f-bc7f-2a92c7309ba3', 'volume_name': 'volume-1301ae43-887b-429f-bc7f-2a92c7309ba3', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c055204f-e101-46fe-a932-fed6e4ec3e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c055204f-e101-46fe-a932-fed6e4ec3e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608d1710-d233-4998-a038-32d1dde21ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:56 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume 1301ae43-887b-429f-bc7f-2a92c7309ba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1301ae43-887b-429f-bc7f-2a92c7309ba3', 'volume_size': 1} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:56 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:56 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-08b09718-4165-4237-b616-786d4e72579c 1073741824" returned: 0 in 0.696s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:56 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-f076b3e3-1e04-419b-af0b-eb3e8788b037 req-8a1cc53f-8a14-4de4-beda-743b92adaf63 tempest-TestStampPattern-1751917379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-08b09718-4165-4237-b616-786d4e72579c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:56 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-08b09718-4165-4237-b616-786d4e72579c Jul 21 19:15:56 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Flow 'volume_create_manager' (00a5f5b3-be28-41f2-a785-9fd05d150b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58740146-45f8-4301-801e-11e411d03870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58740146-45f8-4301-801e-11e411d03870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-820773855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d707dcc7-c959-4404-932f-6341784f1ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e0aea4ba074b2c90fcb3c91cad1084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:57Z,use_quota=True,user_id='aba8ef12c7884a05bb6390fbefa36ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5edfba4b-322c-4b24-9a2d-6ebfb7fb2996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5edfba4b-322c-4b24-9a2d-6ebfb7fb2996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2feceba0-0612-4eeb-ac82-aaf71d9ac74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2feceba0-0612-4eeb-ac82-aaf71d9ac74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd707dcc7-c959-4404-932f-6341784f1ebb', 'volume_name': 'volume-d707dcc7-c959-4404-932f-6341784f1ebb', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6307ce13-a571-4b73-a2bb-298d197036d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6307ce13-a571-4b73-a2bb-298d197036d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a69ac7-1e13-44be-bc92-990b426cc81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:57 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume d707dcc7-c959-4404-932f-6341784f1ebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d707dcc7-c959-4404-932f-6341784f1ebb', 'volume_size': 1} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:57 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.294s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:15:57 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-08b09718-4165-4237-b616-786d4e72579c" returned: 0 in 0.310s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.148s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1213271921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab8797a-59b6-40c5-bb12-f15cc572f650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e0aea4ba074b2c90fcb3c91cad1084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:56Z,use_quota=True,user_id='aba8ef12c7884a05bb6390fbefa36ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Creating volume 3ab8797a-59b6-40c5-bb12-f15cc572f650 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:15:57 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3ab8797a-59b6-40c5-bb12-f15cc572f650 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67585c0-b02c-4981-af79-3af349e98099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b09718-4165-4237-b616-786d4e72579c', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a17d69-5d14-46a1-a8e1-959c03aa43aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:57 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3ab8797a-59b6-40c5-bb12-f15cc572f650 1073741824 Jul 21 19:15:57 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:57 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume volume-08b09718-4165-4237-b616-786d4e72579c (08b09718-4165-4237-b616-786d4e72579c): created successfully Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a17d69-5d14-46a1-a8e1-959c03aa43aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Flow 'volume_create_manager' (ce49c5e5-b71e-416f-b69a-493802fb8027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:57 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8baab4f4-fefc-404c-a99c-a32e97e32163 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Created volume successfully. Jul 21 19:15:57 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3ab8797a-59b6-40c5-bb12-f15cc572f650 1073741824" returned: 0 in 0.470s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3ab8797a-59b6-40c5-bb12-f15cc572f650 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:57 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3ab8797a-59b6-40c5-bb12-f15cc572f650 Jul 21 19:15:57 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:58 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3ab8797a-59b6-40c5-bb12-f15cc572f650" returned: 0 in 0.295s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.453s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1657757194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1301ae43-887b-429f-bc7f-2a92c7309ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e0aea4ba074b2c90fcb3c91cad1084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:56Z,use_quota=True,user_id='aba8ef12c7884a05bb6390fbefa36ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Creating volume 1301ae43-887b-429f-bc7f-2a92c7309ba3 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:15:58 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1301ae43-887b-429f-bc7f-2a92c7309ba3 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77830884-d3ba-4074-9479-7a8de4fb51ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ab8797a-59b6-40c5-bb12-f15cc572f650', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:58 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1301ae43-887b-429f-bc7f-2a92c7309ba3 1073741824 Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88950da6-f2c0-494a-812a-bd0fd801b5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:58 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:58 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume volume-3ab8797a-59b6-40c5-bb12-f15cc572f650 (3ab8797a-59b6-40c5-bb12-f15cc572f650): created successfully Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88950da6-f2c0-494a-812a-bd0fd801b5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Flow 'volume_create_manager' (a010b893-39ae-409e-ba94-3533c55c5583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:58 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-324ce50a-1537-4890-a0ee-8594123f5f5a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Created volume successfully. Jul 21 19:15:58 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1301ae43-887b-429f-bc7f-2a92c7309ba3 1073741824" returned: 0 in 0.503s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1301ae43-887b-429f-bc7f-2a92c7309ba3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:58 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1301ae43-887b-429f-bc7f-2a92c7309ba3 Jul 21 19:15:58 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:58 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1301ae43-887b-429f-bc7f-2a92c7309ba3" returned: 0 in 0.294s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-f076b3e3-1e04-419b-af0b-eb3e8788b037 req-8a1cc53f-8a14-4de4-beda-743b92adaf63 tempest-TestStampPattern-1751917379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.038s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608d1710-d233-4998-a038-32d1dde21ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1301ae43-887b-429f-bc7f-2a92c7309ba3', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364b5bc3-524e-4656-8909-09191ca294ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-f076b3e3-1e04-419b-af0b-eb3e8788b037 req-8a1cc53f-8a14-4de4-beda-743b92adaf63 tempest-TestStampPattern-1751917379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.913s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-820773855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d707dcc7-c959-4404-932f-6341784f1ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e0aea4ba074b2c90fcb3c91cad1084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:57Z,use_quota=True,user_id='aba8ef12c7884a05bb6390fbefa36ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Creating volume d707dcc7-c959-4404-932f-6341784f1ebb {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:15:59 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d707dcc7-c959-4404-932f-6341784f1ebb 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:59 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume volume-1301ae43-887b-429f-bc7f-2a92c7309ba3 (1301ae43-887b-429f-bc7f-2a92c7309ba3): created successfully Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364b5bc3-524e-4656-8909-09191ca294ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:59 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d707dcc7-c959-4404-932f-6341784f1ebb 1073741824 Jul 21 19:15:59 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Flow 'volume_create_manager' (768db76c-8bd2-46f8-9fd1-1bc19afd8d77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:59 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-17f3be85-c938-42d5-9efb-9c61cef144f1 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Created volume successfully. Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-f076b3e3-1e04-419b-af0b-eb3e8788b037 req-8a1cc53f-8a14-4de4-beda-743b92adaf63 tempest-TestStampPattern-1751917379 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30487683-9d22-4102-b3f9-8aa711238a93', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:15:59 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-f076b3e3-1e04-419b-af0b-eb3e8788b037 req-8a1cc53f-8a14-4de4-beda-743b92adaf63 tempest-TestStampPattern-1751917379 None] attachment_update completed successfully. Jul 21 19:15:59 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d707dcc7-c959-4404-932f-6341784f1ebb 1073741824" returned: 0 in 0.559s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d707dcc7-c959-4404-932f-6341784f1ebb {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:59 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d707dcc7-c959-4404-932f-6341784f1ebb Jul 21 19:15:59 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:59 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d707dcc7-c959-4404-932f-6341784f1ebb" returned: 0 in 0.356s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a69ac7-1e13-44be-bc92-990b426cc81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d707dcc7-c959-4404-932f-6341784f1ebb', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4aba46-dc1e-4708-a264-c28c47422ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:00 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Volume volume-d707dcc7-c959-4404-932f-6341784f1ebb (d707dcc7-c959-4404-932f-6341784f1ebb): created successfully Jul 21 19:16:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4aba46-dc1e-4708-a264-c28c47422ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Flow 'volume_create_manager' (00a5f5b3-be28-41f2-a785-9fd05d150b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:00 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-43ff45c7-6a74-4646-995a-d13300352076 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Created volume successfully. Jul 21 19:16:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "cinder-d707dcc7-c959-4404-932f-6341784f1ebb-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-d707dcc7-c959-4404-932f-6341784f1ebb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "cinder-quobyte-d707dcc7-c959-4404-932f-6341784f1ebb" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-quobyte-d707dcc7-c959-4404-932f-6341784f1ebb" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:00 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fde9b3-4bfb-4d3f-9d30-bac44145eb30]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d707dcc7-c959-4404-932f-6341784f1ebb {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:00 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d707dcc7-c959-4404-932f-6341784f1ebb Jul 21 19:16:00 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:00 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d707dcc7-c959-4404-932f-6341784f1ebb" returned: 0 in 0.391s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d707dcc7-c959-4404-932f-6341784f1ebb {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:01 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d707dcc7-c959-4404-932f-6341784f1ebb Jul 21 19:16:01 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:01 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d707dcc7-c959-4404-932f-6341784f1ebb" returned: 0 in 0.300s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-quobyte-d707dcc7-c959-4404-932f-6341784f1ebb" released by "delete_volume" :: held 0.732s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Created reservations ['46d5b899-b4e3-434c-8cd8-72a08576d1b2', '94e55213-b872-41e5-a67c-3e2231347259', 'cf4eecd2-9386-48c3-a4b9-77e5aee6105a', '55f6b092-c067-4b98-b0b6-3412fe0ea84d'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:01 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:16:01 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "cinder-1301ae43-887b-429f-bc7f-2a92c7309ba3-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-1301ae43-887b-429f-bc7f-2a92c7309ba3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:01 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.310s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:01 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Deleted volume successfully. Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "cinder-quobyte-1301ae43-887b-429f-bc7f-2a92c7309ba3" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a838da7e-73f9-4ad3-943b-c7b9d842b4c8 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-d707dcc7-c959-4404-932f-6341784f1ebb-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-quobyte-1301ae43-887b-429f-bc7f-2a92c7309ba3" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[682fe562-43c6-4a70-b992-f34554ef768d]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1301ae43-887b-429f-bc7f-2a92c7309ba3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:01 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1301ae43-887b-429f-bc7f-2a92c7309ba3 Jul 21 19:16:01 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:02 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1301ae43-887b-429f-bc7f-2a92c7309ba3" returned: 0 in 0.435s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1301ae43-887b-429f-bc7f-2a92c7309ba3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:02 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1301ae43-887b-429f-bc7f-2a92c7309ba3 Jul 21 19:16:02 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:02 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1301ae43-887b-429f-bc7f-2a92c7309ba3" returned: 0 in 0.276s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-quobyte-1301ae43-887b-429f-bc7f-2a92c7309ba3" released by "delete_volume" :: held 0.761s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:02 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] Created reservations ['132d7e46-5d6d-4499-a085-6314a1ac6021', '262c2f3b-17ee-4010-9a6a-01ca0530266e', '3d2ba7b5-1355-42c2-a167-12a8bb6f996f', 'de7ca232-e198-4113-ad84-1d67cbf2a4d6'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:02 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:16:02 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "cinder-3ab8797a-59b6-40c5-bb12-f15cc572f650-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-3ab8797a-59b6-40c5-bb12-f15cc572f650-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "cinder-quobyte-3ab8797a-59b6-40c5-bb12-f15cc572f650" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-quobyte-3ab8797a-59b6-40c5-bb12-f15cc572f650" acquired by "delete_volume" :: waited 0.024s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:02 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc51c1ca-108e-4d7d-94c9-4a7b1bc679de]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:02 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3ab8797a-59b6-40c5-bb12-f15cc572f650 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.337s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:03 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:03 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] Deleted volume successfully. Jul 21 19:16:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e23f0591-1833-443f-9cd5-31bd76a8f48b tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-1301ae43-887b-429f-bc7f-2a92c7309ba3-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:03 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3ab8797a-59b6-40c5-bb12-f15cc572f650 Jul 21 19:16:03 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:03 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3ab8797a-59b6-40c5-bb12-f15cc572f650" returned: 0 in 0.429s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3ab8797a-59b6-40c5-bb12-f15cc572f650 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:03 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3ab8797a-59b6-40c5-bb12-f15cc572f650 Jul 21 19:16:03 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:03 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3ab8797a-59b6-40c5-bb12-f15cc572f650" returned: 0 in 0.246s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-quobyte-3ab8797a-59b6-40c5-bb12-f15cc572f650" released by "delete_volume" :: held 0.726s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:03 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Created reservations ['1712f339-3efb-47b3-b0e6-1ea209d3eeb6', '66961cd6-f960-4f63-a2b9-7a767c3e6cfd', 'e229fb46-ad7a-4254-887e-7b6bac50fa28', '0534b99b-b79d-418a-a95e-51e63c6db283'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:03 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:16:03 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "cinder-08b09718-4165-4237-b616-786d4e72579c-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:04 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.268s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:04 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:04 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Deleted volume successfully. Jul 21 19:16:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-08b09718-4165-4237-b616-786d4e72579c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e95ddf5e-5023-4122-8b50-71a6d008a46a tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-3ab8797a-59b6-40c5-bb12-f15cc572f650-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "cinder-quobyte-08b09718-4165-4237-b616-786d4e72579c" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-quobyte-08b09718-4165-4237-b616-786d4e72579c" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:04 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[025a6087-387a-4a86-91a2-c8fb7f826607]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-08b09718-4165-4237-b616-786d4e72579c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:04 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-08b09718-4165-4237-b616-786d4e72579c Jul 21 19:16:04 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:04 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-08b09718-4165-4237-b616-786d4e72579c" returned: 0 in 0.390s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-08b09718-4165-4237-b616-786d4e72579c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:04 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-08b09718-4165-4237-b616-786d4e72579c Jul 21 19:16:04 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:04 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-7c9340c6-64d8-404c-bae7-f5061cc2a55a req-b0fd44da-2123-4aed-b5e0-4daa68684db9 tempest-TestStampPattern-1751917379 None] Terminate volume connection completed successfully. Jul 21 19:16:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-7c9340c6-64d8-404c-bae7-f5061cc2a55a req-b0fd44da-2123-4aed-b5e0-4daa68684db9 tempest-TestStampPattern-1751917379 None] Deleting attachment 30487683-9d22-4102-b3f9-8aa711238a93. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:16:04 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-08b09718-4165-4237-b616-786d4e72579c" returned: 0 in 0.306s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-quobyte-08b09718-4165-4237-b616-786d4e72579c" released by "delete_volume" :: held 0.744s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:04 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] Created reservations ['3a4b860d-d607-4a32-9f60-a4ed9438ab4b', '34604c24-ebcc-48d7-824e-566594de82d9', '48d04b67-88ac-495f-8a1b-05d248daa9e9', '266c525d-9954-43fc-985f-306ef75b7229'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:05 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:16:05 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "cinder-6a857a27-17e2-4e75-b911-ea57e55873e7-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-6a857a27-17e2-4e75-b911-ea57e55873e7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:05 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "cinder-quobyte-6a857a27-17e2-4e75-b911-ea57e55873e7" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.288s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:05 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] Deleted volume successfully. Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-quobyte-6a857a27-17e2-4e75-b911-ea57e55873e7" acquired by "delete_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c2bccaea-4861-48eb-88e3-0bce3e111b3d tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-08b09718-4165-4237-b616-786d4e72579c-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2ac541-6ec9-4133-8321-039caa7292ba]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6a857a27-17e2-4e75-b911-ea57e55873e7 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:05 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6a857a27-17e2-4e75-b911-ea57e55873e7 Jul 21 19:16:05 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:05 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6a857a27-17e2-4e75-b911-ea57e55873e7" returned: 0 in 0.404s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6a857a27-17e2-4e75-b911-ea57e55873e7 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:05 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6a857a27-17e2-4e75-b911-ea57e55873e7 Jul 21 19:16:05 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] Creating offline snapshot b018f538-f6cc-415d-8ff2-a0a0e2d076b9 of volume c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcbefc7-aa69-4130-b3f8-2b682ca584aa]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:06 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-6a857a27-17e2-4e75-b911-ea57e55873e7" returned: 0 in 0.275s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-quobyte-6a857a27-17e2-4e75-b911-ea57e55873e7" released by "delete_volume" :: held 0.723s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Created reservations ['6f401306-8cb3-4085-9b20-cbcdd8b8ec74', '742a429d-b04d-4b5b-8bcf-329b4ac05a9c', 'ac99f7c7-9302-4a43-aab7-b6651f796cb7', 'a6492f7e-c067-4ca5-aaa4-38c4885f3f6e'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:06 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 Jul 21 19:16:06 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:06 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:16:06 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:06 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0" returned: 0 in 0.380s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:06 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9 1G Jul 21 19:16:06 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "cinder-51b085b8-3268-4861-937a-3541eeea0d7d-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-51b085b8-3268-4861-937a-3541eeea0d7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "cinder-quobyte-bc4d3de3-b793-4c7f-bfd4-8d421ff04987" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-quobyte-bc4d3de3-b793-4c7f-bfd4-8d421ff04987" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "cinder-quobyte-51b085b8-3268-4861-937a-3541eeea0d7d" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:06 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-quobyte-51b085b8-3268-4861-937a-3541eeea0d7d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] Deleting offline snapshot 51b085b8-3268-4861-937a-3541eeea0d7d of volume bc4d3de3-b793-4c7f-bfd4-8d421ff04987 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] snapshot_file for this snap is: volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.326s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:06 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Deleted volume successfully. Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b12605-0969-456c-8966-fcdeec8491aa]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-61984f72-132d-484b-b6d8-54b957b2e0f3 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-6a857a27-17e2-4e75-b911-ea57e55873e7-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:06 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d Jul 21 19:16:06 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:06 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9 1G" returned: 0 in 0.476s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:06 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9 Jul 21 19:16:06 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:06 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d" returned: 0 in 0.415s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:16:07 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0abb45f-967f-4263-be36-3e3fa1309799]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:07 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987 Jul 21 19:16:07 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:07 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9" returned: 0 in 0.304s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:07 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9 is being set with open permissions: ugo+rw Jul 21 19:16:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:07 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9 Jul 21 19:16:07 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:07 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987" returned: 0 in 0.391s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:07 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:07 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d Jul 21 19:16:07 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9" returned: 0 in 0.250s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:07 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.info Jul 21 19:16:07 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:07 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.info" returned: 0 in 0.260s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:07 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.info is being set with open permissions: ugo+rw Jul 21 19:16:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:07 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d" returned: 0 in 0.342s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:07 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.info Jul 21 19:16:07 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:07 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d Jul 21 19:16:07 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:08 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:08 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.info" returned: 0 in 0.281s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987.51b085b8-3268-4861-937a-3541eeea0d7d" returned: 0 in 0.258s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.037s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-quobyte-51b085b8-3268-4861-937a-3541eeea0d7d" released by "_delete_snapshot" :: held 1.570s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:08 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-915f15f7-27a3-4273-a1df-d7579817156e tempest-TestStampPattern-1751917379 None] Create snapshot completed successfully Jul 21 19:16:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-quobyte-bc4d3de3-b793-4c7f-bfd4-8d421ff04987" released by "delete_snapshot" :: held 1.597s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:08 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] Created reservations ['5e0f9564-9269-4a71-be5b-4298d249c275', 'd15e30e2-6e64-48fd-b492-a2ec5ac458d9', '0f4dacc3-e204-468c-99ea-23e34192e897', 'cbb9777d-1050-47c5-816a-bdfae8ec90b3'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:08 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] Delete snapshot completed successfully. Jul 21 19:16:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cd41516a-1d1e-46e9-a986-b87a77099b3f tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-51b085b8-3268-4861-937a-3541eeea0d7d-delete_snapshot" released by "delete_snapshot" :: held 1.743s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "cinder-bc4d3de3-b793-4c7f-bfd4-8d421ff04987-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-bc4d3de3-b793-4c7f-bfd4-8d421ff04987-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "cinder-quobyte-bc4d3de3-b793-4c7f-bfd4-8d421ff04987" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-quobyte-bc4d3de3-b793-4c7f-bfd4-8d421ff04987" acquired by "delete_volume" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:08 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6988885-15cb-4adc-8760-17df9203a923]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:08 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987 Jul 21 19:16:08 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:09 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987" returned: 0 in 0.402s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:09 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987 Jul 21 19:16:09 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:09 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc4d3de3-b793-4c7f-bfd4-8d421ff04987" returned: 0 in 0.285s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-quobyte-bc4d3de3-b793-4c7f-bfd4-8d421ff04987" released by "delete_volume" :: held 0.750s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:09 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Created reservations ['f4deac2e-def4-4c2c-a649-666c5fb80ac6', '58faaaee-d43f-4611-8641-fdc77ef76ba4', '04cdaf5c-89fd-403d-a9c9-1fe4c4870883', 'd22a11f3-29d2-4855-b10b-7aea02c22e66'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:09 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:16:09 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:09 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.308s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:09 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:09 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Deleted volume successfully. Jul 21 19:16:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bbee82bf-2acd-4ad0-918e-0c1f40728c56 tempest-CreateVolumesFromSnapshotTest-1323477493 None] Lock "cinder-bc4d3de3-b793-4c7f-bfd4-8d421ff04987-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Flow 'volume_create_manager' (b5558295-7305-46a8-8334-6978aab17994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8b965c-897e-48ab-80e3-222fd7e5b7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8b965c-897e-48ab-80e3-222fd7e5b7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1643514161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93db63478ecd42fa847560c0ec85c66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:13Z,use_quota=True,user_id='dacecc31a10e4af68718ea0f751b95b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e88c98d-9666-4428-afeb-fb3038a937d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e88c98d-9666-4428-afeb-fb3038a937d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130abad2-11d3-4b2f-a18a-f875f506a99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130abad2-11d3-4b2f-a18a-f875f506a99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd10c1a81-c1ff-4d62-af56-c25bc1ba9f3d', 'volume_name': 'volume-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175451bc-5d9b-4c12-8def-26ecdd861535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175451bc-5d9b-4c12-8def-26ecdd861535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0bbfdf3-fbc8-41d3-afef-75d9295c1428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:13 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d', 'volume_size': 1} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1643514161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93db63478ecd42fa847560c0ec85c66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:13Z,use_quota=True,user_id='dacecc31a10e4af68718ea0f751b95b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Creating volume d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:13 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:13 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d 1073741824 Jul 21 19:16:13 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:13 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d 1073741824" returned: 0 in 0.474s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:13 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d Jul 21 19:16:13 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:14 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d" returned: 0 in 0.274s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0bbfdf3-fbc8-41d3-afef-75d9295c1428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b469025-8f98-4b7e-bb6a-d52028386556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:14 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume volume-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d (d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d): created successfully Jul 21 19:16:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b469025-8f98-4b7e-bb6a-d52028386556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:14 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Flow 'volume_create_manager' (b5558295-7305-46a8-8334-6978aab17994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:14 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4d1b4ae8-7a59-422a-92e0-11a4844c9822 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Created volume successfully. Jul 21 19:16:15 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Flow 'volume_create_manager' (6fbdd8bb-08d4-4e57-bc46-77e761487110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663085da-25df-482e-94ed-a0a5949268ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663085da-25df-482e-94ed-a0a5949268ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1269132982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3ffdbb-4a33-4172-9026-92c12497f467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93db63478ecd42fa847560c0ec85c66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:16Z,use_quota=True,user_id='dacecc31a10e4af68718ea0f751b95b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53cfbf81-7286-4980-80a5-258ecdd01537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53cfbf81-7286-4980-80a5-258ecdd01537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85864476-1b0b-4a33-a49d-3d5fb989d2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85864476-1b0b-4a33-a49d-3d5fb989d2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf3ffdbb-4a33-4172-9026-92c12497f467', 'volume_name': 'volume-cf3ffdbb-4a33-4172-9026-92c12497f467', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efac73e5-b8c5-44d4-8e20-ac909adb25f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efac73e5-b8c5-44d4-8e20-ac909adb25f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e975ae5-b554-4f7a-ab62-ad25dc724015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:15 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume cf3ffdbb-4a33-4172-9026-92c12497f467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf3ffdbb-4a33-4172-9026-92c12497f467', 'volume_size': 1} Jul 21 19:16:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1269132982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3ffdbb-4a33-4172-9026-92c12497f467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93db63478ecd42fa847560c0ec85c66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:16Z,use_quota=True,user_id='dacecc31a10e4af68718ea0f751b95b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Creating volume cf3ffdbb-4a33-4172-9026-92c12497f467 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:16 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf3ffdbb-4a33-4172-9026-92c12497f467 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:16 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf3ffdbb-4a33-4172-9026-92c12497f467 1073741824 Jul 21 19:16:16 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Flow 'volume_create_manager' (038fbd7f-b7f7-4f97-90b4-594c0b094941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e1f005-5ed8-41c8-9d5a-7016c5173594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e1f005-5ed8-41c8-9d5a-7016c5173594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1293206928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac113c3e-ce36-431b-aca3-73ebf6dc9379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f32621a8394f0cb29b8bdfdd614952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b018f538-f6cc-415d-8ff2-a0a0e2d076b9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:16Z,use_quota=True,user_id='6d5823790c7a438f8d467ca297e7bca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b64d5a6-1a2c-49ec-9720-dcfca121749b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b64d5a6-1a2c-49ec-9720-dcfca121749b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d4c6bb-5579-41c1-87e8-95d10597bad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d4c6bb-5579-41c1-87e8-95d10597bad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac113c3e-ce36-431b-aca3-73ebf6dc9379', 'volume_name': 'volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379', 'volume_size': 1, 'snapshot_id': 'b018f538-f6cc-415d-8ff2-a0a0e2d076b9'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c660a7-54dd-47d5-a811-e4f593be53c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c660a7-54dd-47d5-a811-e4f593be53c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d6c476-f577-48c7-8475-5fe63cc7edd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:16 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Volume ac113c3e-ce36-431b-aca3-73ebf6dc9379: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379', 'volume_size': 1, 'snapshot_id': 'b018f538-f6cc-415d-8ff2-a0a0e2d076b9'} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Flow 'volume_create_manager' (1f25a326-11f3-419e-b131-72fb64199fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e598ebf-1e8b-46a2-bc50-77e4e7783b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e598ebf-1e8b-46a2-bc50-77e4e7783b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-288326460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be294598-b1d7-4295-8df5-bbfbdf7ca9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93db63478ecd42fa847560c0ec85c66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:16Z,use_quota=True,user_id='dacecc31a10e4af68718ea0f751b95b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60321601-d8e0-4bf4-9cc1-17fac278d989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60321601-d8e0-4bf4-9cc1-17fac278d989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57cca4d-c0a0-40ad-973b-cf6d614b3f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57cca4d-c0a0-40ad-973b-cf6d614b3f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be294598-b1d7-4295-8df5-bbfbdf7ca9ca', 'volume_name': 'volume-be294598-b1d7-4295-8df5-bbfbdf7ca9ca', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19da863c-e34f-442b-8b14-efd9964d8b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19da863c-e34f-442b-8b14-efd9964d8b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f5b04e-d1bf-4b59-9a3c-92ef80128f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:16 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume be294598-b1d7-4295-8df5-bbfbdf7ca9ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be294598-b1d7-4295-8df5-bbfbdf7ca9ca', 'volume_size': 1} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:16 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf3ffdbb-4a33-4172-9026-92c12497f467 1073741824" returned: 0 in 0.706s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf3ffdbb-4a33-4172-9026-92c12497f467 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:16 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf3ffdbb-4a33-4172-9026-92c12497f467 Jul 21 19:16:16 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Flow 'volume_create_manager' (572f2605-05a4-4b2c-9757-6d699e061200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668beef7-1f8a-4987-8838-234668a9f2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668beef7-1f8a-4987-8838-234668a9f2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-547232502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a453c7b7-c548-4aea-a2a4-3aa1aa56506f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93db63478ecd42fa847560c0ec85c66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:17Z,use_quota=True,user_id='dacecc31a10e4af68718ea0f751b95b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c94b696-3796-4335-af4b-725cb2a486a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c94b696-3796-4335-af4b-725cb2a486a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f05a84d-5324-4c7e-9550-a5b02be4ed01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f05a84d-5324-4c7e-9550-a5b02be4ed01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a453c7b7-c548-4aea-a2a4-3aa1aa56506f', 'volume_name': 'volume-a453c7b7-c548-4aea-a2a4-3aa1aa56506f', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2a6d19-1430-443c-a93a-f5a87e4dc6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2a6d19-1430-443c-a93a-f5a87e4dc6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8de0e55-268e-483e-a16b-28a1ac200107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume a453c7b7-c548-4aea-a2a4-3aa1aa56506f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a453c7b7-c548-4aea-a2a4-3aa1aa56506f', 'volume_size': 1} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:17 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf3ffdbb-4a33-4172-9026-92c12497f467" returned: 0 in 0.370s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.577s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Acquiring lock "cinder-quobyte-b018f538-f6cc-415d-8ff2-a0a0e2d076b9-ac113c3e-ce36-431b-aca3-73ebf6dc9379" by "_create_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e975ae5-b554-4f7a-ab62-ad25dc724015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf3ffdbb-4a33-4172-9026-92c12497f467', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f462bf54-3b4e-4687-ad20-d450b8d7b914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Lock "cinder-quobyte-b018f538-f6cc-415d-8ff2-a0a0e2d076b9-ac113c3e-ce36-431b-aca3-73ebf6dc9379" acquired by "_create_volume_from_snapshot" :: waited 0.057s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Creating volume ac113c3e-ce36-431b-aca3-73ebf6dc9379 from snapshot b018f538-f6cc-415d-8ff2-a0a0e2d076b9 {{(pid=87570) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Acquiring lock "cinder-quobyte-ac113c3e-ce36-431b-aca3-73ebf6dc9379" by "_copy_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Lock "cinder-quobyte-ac113c3e-ce36-431b-aca3-73ebf6dc9379" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] snapshot: b018f538-f6cc-415d-8ff2-a0a0e2d076b9, volume: ac113c3e-ce36-431b-aca3-73ebf6dc9379, {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:16:17 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume volume-cf3ffdbb-4a33-4172-9026-92c12497f467 (cf3ffdbb-4a33-4172-9026-92c12497f467): created successfully Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f462bf54-3b4e-4687-ad20-d450b8d7b914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Flow 'volume_create_manager' (6fbdd8bb-08d4-4e57-bc46-77e761487110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:17 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f775e277-48e2-4022-a4fb-c2813a059a76 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Created volume successfully. Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9683830-da89-4ca6-b4a0-f43537459448]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Flow 'volume_create_manager' (c17570b3-8696-4efc-957b-e47a00aca759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e790c43-f9aa-417b-ac4b-dd17457c8fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e790c43-f9aa-417b-ac4b-dd17457c8fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-630892137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93db63478ecd42fa847560c0ec85c66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:17Z,use_quota=True,user_id='dacecc31a10e4af68718ea0f751b95b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5557bb47-b2ce-42b4-912a-c4d84eea6344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5557bb47-b2ce-42b4-912a-c4d84eea6344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9 Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6bfd9e-ade1-4c0c-a35a-1e09a5d80088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6bfd9e-ade1-4c0c-a35a-1e09a5d80088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3', 'volume_name': 'volume-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e0b93a-7ef6-42c6-be5f-2fcf3d4f9dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e0b93a-7ef6-42c6-be5f-2fcf3d4f9dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93627d3-a31f-4d65-b27e-93108104d7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3', 'volume_size': 1} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:17 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9" returned: 0 in 0.536s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Creating direct copy from snapshot {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Flow 'volume_create_manager' (9387efcf-52b2-48f3-b24c-53ad72b0d5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb219226-3539-4a20-88db-f411c92f81cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b2c55a-db81-4ee5-b3f4-3a7dc6bc38c4]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb219226-3539-4a20-88db-f411c92f81cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-895074778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76fb6e3a-7fb3-498d-befe-fda13ee203ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93db63478ecd42fa847560c0ec85c66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:18Z,use_quota=True,user_id='dacecc31a10e4af68718ea0f751b95b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec39822-b3c5-40ae-9432-9cb977d68ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec39822-b3c5-40ae-9432-9cb977d68ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95167435-2ccc-4dcb-b693-42392d130400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95167435-2ccc-4dcb-b693-42392d130400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76fb6e3a-7fb3-498d-befe-fda13ee203ea', 'volume_name': 'volume-76fb6e3a-7fb3-498d-befe-fda13ee203ea', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d0709b-7820-4121-bbcf-44a1c2fc0002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d0709b-7820-4121-bbcf-44a1c2fc0002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da886e92-8b89-4583-baa4-12fd53377c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume 76fb6e3a-7fb3-498d-befe-fda13ee203ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76fb6e3a-7fb3-498d-befe-fda13ee203ea', 'volume_size': 1} Jul 21 19:16:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:18 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 Jul 21 19:16:18 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:18 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0" returned: 0 in 0.422s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:18 devstack cinder-volume[87570]: DEBUG cinder.utils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Path /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379 not found in is_blk_device check {{(pid=87570) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:16:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:18 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379 Jul 21 19:16:18 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:24 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379" returned: 0 in 6.066s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:24 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[7116ff0f-bb30-4d69-bfce-b74dea5b69f1]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:24 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 Jul 21 19:16:24 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:25 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0" returned: 0 in 0.619s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Image conversion details: src /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379 {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:16:25 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Converted 1024.00 MB image at 168.77 MB/s Jul 21 19:16:25 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379 is being set with open permissions: ugo+rw Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:25 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379 Jul 21 19:16:25 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:25 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379" returned: 0 in 0.337s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Lock "cinder-quobyte-ac113c3e-ce36-431b-aca3-73ebf6dc9379" released by "_copy_volume_from_snapshot" :: held 8.173s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Lock "cinder-quobyte-b018f538-f6cc-415d-8ff2-a0a0e2d076b9-ac113c3e-ce36-431b-aca3-73ebf6dc9379" released by "_create_volume_from_snapshot" :: held 8.220s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.279s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.740s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-288326460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be294598-b1d7-4295-8df5-bbfbdf7ca9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93db63478ecd42fa847560c0ec85c66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:16Z,use_quota=True,user_id='dacecc31a10e4af68718ea0f751b95b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Creating volume be294598-b1d7-4295-8df5-bbfbdf7ca9ca {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:25 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-be294598-b1d7-4295-8df5-bbfbdf7ca9ca 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:25 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-be294598-b1d7-4295-8df5-bbfbdf7ca9ca 1073741824 Jul 21 19:16:25 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d6c476-f577-48c7-8475-5fe63cc7edd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379', 'volume_size': 1, 'snapshot_id': 'b018f538-f6cc-415d-8ff2-a0a0e2d076b9'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a04540-991a-4054-b44e-877e8154731c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:25 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Volume volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379 (ac113c3e-ce36-431b-aca3-73ebf6dc9379): created successfully Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a04540-991a-4054-b44e-877e8154731c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Flow 'volume_create_manager' (038fbd7f-b7f7-4f97-90b4-594c0b094941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:25 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-9d53ce6d-855c-4e59-a3ca-25f7b57c4584 tempest-TestStampPattern-1751917379 None] Created volume successfully. Jul 21 19:16:25 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-be294598-b1d7-4295-8df5-bbfbdf7ca9ca 1073741824" returned: 0 in 0.542s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-be294598-b1d7-4295-8df5-bbfbdf7ca9ca {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:26 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-be294598-b1d7-4295-8df5-bbfbdf7ca9ca Jul 21 19:16:26 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:26 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-be294598-b1d7-4295-8df5-bbfbdf7ca9ca" returned: 0 in 0.471s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.463s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-547232502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a453c7b7-c548-4aea-a2a4-3aa1aa56506f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93db63478ecd42fa847560c0ec85c66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:17Z,use_quota=True,user_id='dacecc31a10e4af68718ea0f751b95b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Creating volume a453c7b7-c548-4aea-a2a4-3aa1aa56506f {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:26 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a453c7b7-c548-4aea-a2a4-3aa1aa56506f 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:26 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a453c7b7-c548-4aea-a2a4-3aa1aa56506f 1073741824 Jul 21 19:16:26 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f5b04e-d1bf-4b59-9a3c-92ef80128f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be294598-b1d7-4295-8df5-bbfbdf7ca9ca', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c95f2a9-b633-4570-850b-013d17e75ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:26 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume volume-be294598-b1d7-4295-8df5-bbfbdf7ca9ca (be294598-b1d7-4295-8df5-bbfbdf7ca9ca): created successfully Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c95f2a9-b633-4570-850b-013d17e75ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Flow 'volume_create_manager' (1f25a326-11f3-419e-b131-72fb64199fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:26 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-d51009b7-3c88-4a3a-aed6-2feb48c1b749 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Created volume successfully. Jul 21 19:16:27 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a453c7b7-c548-4aea-a2a4-3aa1aa56506f 1073741824" returned: 0 in 0.752s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a453c7b7-c548-4aea-a2a4-3aa1aa56506f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:27 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a453c7b7-c548-4aea-a2a4-3aa1aa56506f Jul 21 19:16:27 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:27 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a453c7b7-c548-4aea-a2a4-3aa1aa56506f" returned: 0 in 0.296s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.136s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-630892137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93db63478ecd42fa847560c0ec85c66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:17Z,use_quota=True,user_id='dacecc31a10e4af68718ea0f751b95b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Creating volume ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:27 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:27 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3 1073741824 Jul 21 19:16:27 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8de0e55-268e-483e-a16b-28a1ac200107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a453c7b7-c548-4aea-a2a4-3aa1aa56506f', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af83191-4600-4ca7-82cc-51cc0b1f12ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:27 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume volume-a453c7b7-c548-4aea-a2a4-3aa1aa56506f (a453c7b7-c548-4aea-a2a4-3aa1aa56506f): created successfully Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af83191-4600-4ca7-82cc-51cc0b1f12ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Flow 'volume_create_manager' (572f2605-05a4-4b2c-9757-6d699e061200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:27 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c93a1833-ca50-44cf-88d4-61f17c132626 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Created volume successfully. Jul 21 19:16:28 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3 1073741824" returned: 0 in 0.727s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:28 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3 Jul 21 19:16:28 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:28 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3" returned: 0 in 0.284s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.725s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-895074778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76fb6e3a-7fb3-498d-befe-fda13ee203ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93db63478ecd42fa847560c0ec85c66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:18Z,use_quota=True,user_id='dacecc31a10e4af68718ea0f751b95b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Creating volume 76fb6e3a-7fb3-498d-befe-fda13ee203ea {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:28 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76fb6e3a-7fb3-498d-befe-fda13ee203ea 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93627d3-a31f-4d65-b27e-93108104d7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:28 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76fb6e3a-7fb3-498d-befe-fda13ee203ea 1073741824 Jul 21 19:16:28 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5e92ff-2b03-46b1-82ad-3c5c9b8dea1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:28 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume volume-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3 (ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3): created successfully Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5e92ff-2b03-46b1-82ad-3c5c9b8dea1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:28 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Flow 'volume_create_manager' (c17570b3-8696-4efc-957b-e47a00aca759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:28 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8a427b34-e3f0-49f6-a856-51d8f2751d8e tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Created volume successfully. Jul 21 19:16:29 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76fb6e3a-7fb3-498d-befe-fda13ee203ea 1073741824" returned: 0 in 0.505s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76fb6e3a-7fb3-498d-befe-fda13ee203ea {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:29 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76fb6e3a-7fb3-498d-befe-fda13ee203ea Jul 21 19:16:29 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:29 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76fb6e3a-7fb3-498d-befe-fda13ee203ea" returned: 0 in 0.372s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:29 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:29 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da886e92-8b89-4583-baa4-12fd53377c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76fb6e3a-7fb3-498d-befe-fda13ee203ea', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:29 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4be26f-6f45-465c-b0a3-c23a847ee705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:29 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Volume volume-76fb6e3a-7fb3-498d-befe-fda13ee203ea (76fb6e3a-7fb3-498d-befe-fda13ee203ea): created successfully Jul 21 19:16:29 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4be26f-6f45-465c-b0a3-c23a847ee705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:29 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Flow 'volume_create_manager' (9387efcf-52b2-48f3-b24c-53ad72b0d5f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:29 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-53db7177-4e6e-4458-8aca-3fbe70992060 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Created volume successfully. Jul 21 19:16:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "cinder-76fb6e3a-7fb3-498d-befe-fda13ee203ea-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-76fb6e3a-7fb3-498d-befe-fda13ee203ea-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "cinder-quobyte-76fb6e3a-7fb3-498d-befe-fda13ee203ea" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-quobyte-76fb6e3a-7fb3-498d-befe-fda13ee203ea" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:30 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf67496-2411-461e-bb58-07ae6f8a7126]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76fb6e3a-7fb3-498d-befe-fda13ee203ea {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:31 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76fb6e3a-7fb3-498d-befe-fda13ee203ea Jul 21 19:16:31 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:31 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76fb6e3a-7fb3-498d-befe-fda13ee203ea" returned: 0 in 0.447s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76fb6e3a-7fb3-498d-befe-fda13ee203ea {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:31 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76fb6e3a-7fb3-498d-befe-fda13ee203ea Jul 21 19:16:31 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:31 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-76fb6e3a-7fb3-498d-befe-fda13ee203ea" returned: 0 in 0.270s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:31 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-quobyte-76fb6e3a-7fb3-498d-befe-fda13ee203ea" released by "delete_volume" :: held 0.808s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:31 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Created reservations ['5ee21599-00ba-4439-85e2-d05367f7ec77', 'de4379c8-0c35-4938-81f2-d0e264a47679', '04a77bfd-085c-4718-9272-b1270c2bc2c7', '542feb1c-89b4-42c8-8566-36d4501a6c70'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:31 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:16:31 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:31 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "cinder-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:31 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "cinder-quobyte-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-quobyte-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3" acquired by "delete_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:32 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[15148cb4-dfc3-403a-8a45-c75a2ac36a5e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:32 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.364s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:32 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:32 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Deleted volume successfully. Jul 21 19:16:32 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3 Jul 21 19:16:32 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-db84fdf3-b30c-4b41-8bac-5629899fb32d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-76fb6e3a-7fb3-498d-befe-fda13ee203ea-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:32 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3" returned: 0 in 0.458s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:32 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3 Jul 21 19:16:32 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:32 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3" returned: 0 in 0.292s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-quobyte-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3" released by "delete_volume" :: held 0.805s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:32 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Created reservations ['c9a705ae-12c3-436a-94d7-df546d62bda7', '1ba39698-e8a9-4a3b-8b3d-64c2414c9847', 'b4c817cb-d646-4d35-9f8b-5d7b51b5c1c4', '4d65b145-8d7d-4d33-962c-b8faaa2d5364'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:33 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:16:33 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "cinder-a453c7b7-c548-4aea-a2a4-3aa1aa56506f-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-a453c7b7-c548-4aea-a2a4-3aa1aa56506f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "cinder-quobyte-a453c7b7-c548-4aea-a2a4-3aa1aa56506f" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-quobyte-a453c7b7-c548-4aea-a2a4-3aa1aa56506f" acquired by "delete_volume" :: waited 0.015s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4be9ec-0569-48c0-a89f-4b2c08ab8044]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a453c7b7-c548-4aea-a2a4-3aa1aa56506f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:33 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.299s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:33 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Deleted volume successfully. Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d7f1bfdd-f7f3-4730-b545-8ccabdc2c543 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-ea05dc0c-fa48-43a8-9c63-6e1e3d2776b3-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:33 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a453c7b7-c548-4aea-a2a4-3aa1aa56506f Jul 21 19:16:33 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:33 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a453c7b7-c548-4aea-a2a4-3aa1aa56506f" returned: 0 in 0.369s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a453c7b7-c548-4aea-a2a4-3aa1aa56506f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:33 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a453c7b7-c548-4aea-a2a4-3aa1aa56506f Jul 21 19:16:33 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:33 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a453c7b7-c548-4aea-a2a4-3aa1aa56506f" returned: 0 in 0.257s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-quobyte-a453c7b7-c548-4aea-a2a4-3aa1aa56506f" released by "delete_volume" :: held 0.677s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Created reservations ['717cea74-6458-49ec-8415-326649553820', '2b03c417-f349-44ce-9a47-d057f45d3bd2', '46a1d91b-e07d-43e5-a6f6-0bf5f3e666fd', 'e67ee411-b1c8-4a2f-b08f-7d430949bf49'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:34 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:16:34 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "cinder-be294598-b1d7-4295-8df5-bbfbdf7ca9ca-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-be294598-b1d7-4295-8df5-bbfbdf7ca9ca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:34 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.292s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:34 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Deleted volume successfully. Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "cinder-quobyte-be294598-b1d7-4295-8df5-bbfbdf7ca9ca" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d7c53871-f220-425e-ba29-381e024914ef tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-a453c7b7-c548-4aea-a2a4-3aa1aa56506f-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-quobyte-be294598-b1d7-4295-8df5-bbfbdf7ca9ca" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f69955-0811-4fc9-b15b-ce0a1c3b59a9]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-be294598-b1d7-4295-8df5-bbfbdf7ca9ca {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:34 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-be294598-b1d7-4295-8df5-bbfbdf7ca9ca Jul 21 19:16:34 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:34 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-be294598-b1d7-4295-8df5-bbfbdf7ca9ca" returned: 0 in 0.359s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-be294598-b1d7-4295-8df5-bbfbdf7ca9ca {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:34 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-be294598-b1d7-4295-8df5-bbfbdf7ca9ca Jul 21 19:16:34 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:35 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-be294598-b1d7-4295-8df5-bbfbdf7ca9ca" returned: 0 in 0.249s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-quobyte-be294598-b1d7-4295-8df5-bbfbdf7ca9ca" released by "delete_volume" :: held 0.647s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Created reservations ['f2aed196-1850-4339-b725-6070c814b5aa', 'e5d728c8-db5d-4dd6-80e4-f4f3d8b2eb39', '0992766e-a1af-47bf-a70e-f7943958d22b', '11d43eed-18e1-4637-b749-9cd2d3f4ecb2'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:35 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:16:35 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:35 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.266s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:35 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Deleted volume successfully. Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-72864c3f-0f0a-49ec-9eea-10539fd7a1b7 tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-be294598-b1d7-4295-8df5-bbfbdf7ca9ca-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "cinder-cf3ffdbb-4a33-4172-9026-92c12497f467-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-cf3ffdbb-4a33-4172-9026-92c12497f467-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "cinder-quobyte-cf3ffdbb-4a33-4172-9026-92c12497f467" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-quobyte-cf3ffdbb-4a33-4172-9026-92c12497f467" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd90db2c-f95d-425b-8c4c-ff87e21f8eda]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf3ffdbb-4a33-4172-9026-92c12497f467 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:35 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf3ffdbb-4a33-4172-9026-92c12497f467 Jul 21 19:16:35 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:35 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf3ffdbb-4a33-4172-9026-92c12497f467" returned: 0 in 0.380s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf3ffdbb-4a33-4172-9026-92c12497f467 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:36 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf3ffdbb-4a33-4172-9026-92c12497f467 Jul 21 19:16:36 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:36 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-cf3ffdbb-4a33-4172-9026-92c12497f467" returned: 0 in 0.252s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-quobyte-cf3ffdbb-4a33-4172-9026-92c12497f467" released by "delete_volume" :: held 0.670s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Created reservations ['d4f565ee-332d-46a5-9800-a6e03adc81e7', '9db71acc-436b-4746-a530-2fb4f315c306', '82d1280f-7394-43d5-a4b1-587eacbd4c9f', '1a938037-856d-47ab-b5a3-9cccef81a761'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:36 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:16:36 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:36 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "cinder-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.259s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:36 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Deleted volume successfully. Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0525ba20-a42f-49ef-a032-ddce04cef33d tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-cf3ffdbb-4a33-4172-9026-92c12497f467-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "cinder-quobyte-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-quobyte-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d" acquired by "delete_volume" :: waited 0.015s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24f277a-7899-403e-bc09-4dc893f3e3ec]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:36 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d Jul 21 19:16:36 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:37 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d" returned: 0 in 0.362s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:37 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d Jul 21 19:16:37 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:37 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d" returned: 0 in 0.256s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-quobyte-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d" released by "delete_volume" :: held 0.659s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:37 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Created reservations ['0eff171e-5672-4781-b71e-c2fcc8023769', '28b0c3d6-fa53-41f3-ae50-ee29e5281e62', '11dbdce6-7045-47f6-b3aa-13af92d8b012', '67ac08b5-4ac7-4ac6-a5d7-29e307c13084'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:37 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:16:37 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:37 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.244s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:37 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:37 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Deleted volume successfully. Jul 21 19:16:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-14acd248-46ac-4a6f-a4df-b7727055e0fc tempest-CreateVolumesFromSourceVolumeTest-2099931643 None] Lock "cinder-d10c1a81-c1ff-4d62-af56-c25bc1ba9f3d-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Flow 'volume_create_manager' (4fdd6345-d4fc-40fe-96b7-e827002639e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f2edbf-4ce4-4f32-aa38-c7dc80ee79f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f2edbf-4ce4-4f32-aa38-c7dc80ee79f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-75866770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9a53d0-2869-4494-9e6d-4d54e7dfa6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7f5636e6d547ce922b373dacc63259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:41Z,use_quota=True,user_id='f78d5b489dcb45a79c06f33aff21128a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb38f4c-ca8e-4adb-89d8-7a2c6fb46d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb38f4c-ca8e-4adb-89d8-7a2c6fb46d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678a51b2-cf73-4622-8b70-76f60965e3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678a51b2-cf73-4622-8b70-76f60965e3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af9a53d0-2869-4494-9e6d-4d54e7dfa6b0', 'volume_name': 'volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd35badb-121f-4172-b92c-6744808db43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd35badb-121f-4172-b92c-6744808db43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b812204a-3152-4218-a02d-2d9ef506c17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:41 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Volume af9a53d0-2869-4494-9e6d-4d54e7dfa6b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0', 'volume_size': 1} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-75866770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9a53d0-2869-4494-9e6d-4d54e7dfa6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7f5636e6d547ce922b373dacc63259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:41Z,use_quota=True,user_id='f78d5b489dcb45a79c06f33aff21128a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Creating volume af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:41 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:41 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 1073741824 Jul 21 19:16:41 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:41 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 1073741824" returned: 0 in 0.431s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:41 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 Jul 21 19:16:41 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:41 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0" returned: 0 in 0.250s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b812204a-3152-4218-a02d-2d9ef506c17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7b103f-7a93-48e6-848d-fc506f1cc122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:41 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Volume volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 (af9a53d0-2869-4494-9e6d-4d54e7dfa6b0): created successfully Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7b103f-7a93-48e6-848d-fc506f1cc122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Flow 'volume_create_manager' (4fdd6345-d4fc-40fe-96b7-e827002639e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:41 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0e6b326e-d16f-48df-ae5f-bcb414c7d3b3 tempest-VolumeDependencyTests-195774688 None] Created volume successfully. Jul 21 19:16:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] Creating offline snapshot 74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 of volume af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:16:42 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9759d646-67ba-4f3c-ac3f-69e46f76552b]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:42 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 Jul 21 19:16:42 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:42 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0" returned: 0 in 0.344s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:42 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 1G Jul 21 19:16:42 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:43 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 1G" returned: 0 in 0.389s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:43 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 Jul 21 19:16:43 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:43 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1" returned: 0 in 0.295s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:43 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 is being set with open permissions: ugo+rw Jul 21 19:16:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:43 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 Jul 21 19:16:43 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:43 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1" returned: 0 in 0.240s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:43 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=148,cinder:SELECT=116,cinder:DELETE=12,cinder:INSERT=34 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:16:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:43 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.info Jul 21 19:16:43 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:43 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.info" returned: 0 in 0.272s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:43 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.info is being set with open permissions: ugo+rw Jul 21 19:16:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:43 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.info Jul 21 19:16:43 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:44 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.info" returned: 0 in 0.258s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:44 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=108,cinder:UPDATE=148,cinder:INSERT=34,cinder:DELETE=16 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:16:44 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-7d8a2abf-17f7-442f-9c29-66932a64a2ca tempest-VolumeDependencyTests-195774688 None] Create snapshot completed successfully Jul 21 19:16:44 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Flow 'volume_create_manager' (0b5fb3a3-469a-4292-be96-fa9ca3a26336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96204590-dfc7-4559-90eb-298708d307f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96204590-dfc7-4559-90eb-298708d307f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2049839558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aab4fec-040b-4bd4-a916-6818bc6d0d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7f5636e6d547ce922b373dacc63259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:45Z,use_quota=True,user_id='f78d5b489dcb45a79c06f33aff21128a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8ad4cf-ebad-43bc-ac7b-a427b84d21e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8ad4cf-ebad-43bc-ac7b-a427b84d21e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2e7184-3c5d-4ae0-b7a5-a1d518b78090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2e7184-3c5d-4ae0-b7a5-a1d518b78090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2aab4fec-040b-4bd4-a916-6818bc6d0d5e', 'volume_name': 'volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e', 'volume_size': 1, 'snapshot_id': '74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f28ec3a-e973-430d-8b54-1068fe737cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f28ec3a-e973-430d-8b54-1068fe737cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4735d6c-6648-4677-8015-048f9090643e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:45 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Volume 2aab4fec-040b-4bd4-a916-6818bc6d0d5e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e', 'volume_size': 1, 'snapshot_id': '74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1'} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Acquiring lock "cinder-quobyte-74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1-2aab4fec-040b-4bd4-a916-6818bc6d0d5e" by "_create_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Lock "cinder-quobyte-74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1-2aab4fec-040b-4bd4-a916-6818bc6d0d5e" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Creating volume 2aab4fec-040b-4bd4-a916-6818bc6d0d5e from snapshot 74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 {{(pid=87570) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Acquiring lock "cinder-quobyte-2aab4fec-040b-4bd4-a916-6818bc6d0d5e" by "_copy_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Lock "cinder-quobyte-2aab4fec-040b-4bd4-a916-6818bc6d0d5e" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] snapshot: 74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1, volume: 2aab4fec-040b-4bd4-a916-6818bc6d0d5e, {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20bd4eb-8880-4371-8c00-780f1b978ba3]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:45 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 Jul 21 19:16:45 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:45 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1" returned: 0 in 0.358s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Creating direct copy from snapshot {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf10b9b-75d6-4407-9d6b-7a496ab2c9da]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:45 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 Jul 21 19:16:45 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:45 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0" returned: 0 in 0.364s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG cinder.utils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Path /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e not found in is_blk_device check {{(pid=87570) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:16:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:45 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e Jul 21 19:16:45 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:50 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e" returned: 0 in 4.442s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:50 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[af23df87-684b-4032-b521-3de34dac5885]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:50 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 Jul 21 19:16:50 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:50 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0" returned: 0 in 0.547s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:50 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Image conversion details: src /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0, size 1024.00 MB, duration 4.44 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:16:50 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Converted 1024.00 MB image at 230.41 MB/s Jul 21 19:16:50 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e is being set with open permissions: ugo+rw Jul 21 19:16:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:50 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e Jul 21 19:16:50 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:51 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e" returned: 0 in 0.285s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Lock "cinder-quobyte-2aab4fec-040b-4bd4-a916-6818bc6d0d5e" released by "_copy_volume_from_snapshot" :: held 6.090s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Lock "cinder-quobyte-74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1-2aab4fec-040b-4bd4-a916-6818bc6d0d5e" released by "_create_volume_from_snapshot" :: held 6.120s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.136s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4735d6c-6648-4677-8015-048f9090643e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e', 'volume_size': 1, 'snapshot_id': '74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceade617-6527-4005-a546-a96e85175c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:51 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Volume volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e (2aab4fec-040b-4bd4-a916-6818bc6d0d5e): created successfully Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceade617-6527-4005-a546-a96e85175c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Flow 'volume_create_manager' (0b5fb3a3-469a-4292-be96-fa9ca3a26336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:51 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4bf8c0a7-738a-4355-929b-1a9fc49143dd tempest-VolumeDependencyTests-195774688 None] Created volume successfully. Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] Acquiring lock "cinder-74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] Lock "cinder-74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] Acquiring lock "cinder-quobyte-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] Lock "cinder-quobyte-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] Acquiring lock "cinder-quobyte-74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] Lock "cinder-quobyte-74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] Deleting offline snapshot 74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 of volume af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] snapshot_file for this snap is: volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6ecba0-317d-4bb9-a956-529ca895d542]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:51 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 Jul 21 19:16:51 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:52 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1" returned: 0 in 0.395s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:16:52 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6ac06f-fc2e-4cff-8e41-8e01e23523f9]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:52 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 Jul 21 19:16:52 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:52 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0" returned: 0 in 0.348s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:52 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 Jul 21 19:16:52 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:52 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1" returned: 0 in 0.369s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:52 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1 Jul 21 19:16:52 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:53 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0.74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1" returned: 0 in 0.267s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] Lock "cinder-quobyte-74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1" released by "_delete_snapshot" :: held 1.483s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] Lock "cinder-quobyte-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0" released by "delete_snapshot" :: held 1.504s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:53 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] Created reservations ['70d756c8-3ce7-4b06-ba3f-a619c7317df9', 'b464e391-93a8-4b77-af02-25eb985533fa', '88efeb91-baaf-4a2f-b62e-16a00c4b8ac7', '91c10baa-1481-421a-a063-69b33bab033e'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:53 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] Delete snapshot completed successfully. Jul 21 19:16:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-50635fe9-d1b3-43aa-bc64-c96aecf8f534 tempest-VolumeDependencyTests-195774688 None] Lock "cinder-74fbfad5-fdb5-4a26-9bb8-9c2febbff1c1-delete_snapshot" released by "delete_snapshot" :: held 1.681s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] Acquiring lock "cinder-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] Lock "cinder-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] Acquiring lock "cinder-quobyte-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] Lock "cinder-quobyte-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0" acquired by "delete_volume" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:53 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6866401-71b2-40af-812d-42a480993017]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:53 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 Jul 21 19:16:53 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:54 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0" returned: 0 in 0.397s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:54 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0 Jul 21 19:16:54 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:54 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0" returned: 0 in 0.271s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] Lock "cinder-quobyte-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0" released by "delete_volume" :: held 0.745s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:54 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] Created reservations ['75291560-4aa8-44f0-bfd6-983416b12345', '3f87d4ea-c14b-45ad-a48b-d4096d485562', '8ce698cf-2d7d-473c-bd79-45bf7db4a823', '06b40f05-2c6b-436e-bfc0-8b8018e32d80'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:54 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:16:54 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] Acquiring lock "cinder-2aab4fec-040b-4bd4-a916-6818bc6d0d5e-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:54 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] Lock "cinder-2aab4fec-040b-4bd4-a916-6818bc6d0d5e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] Acquiring lock "cinder-quobyte-2aab4fec-040b-4bd4-a916-6818bc6d0d5e" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:55 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] Lock "cinder-quobyte-2aab4fec-040b-4bd4-a916-6818bc6d0d5e" acquired by "delete_volume" :: waited 0.025s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.314s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:55 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] Deleted volume successfully. Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[002fce5e-facb-461d-86e8-4da20ebd81a0]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8e1df75a-765d-4e09-9e3c-5d6e537c165d tempest-VolumeDependencyTests-195774688 None] Lock "cinder-af9a53d0-2869-4494-9e6d-4d54e7dfa6b0-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:55 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e Jul 21 19:16:55 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:55 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e" returned: 0 in 0.407s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:55 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e Jul 21 19:16:55 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:55 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2aab4fec-040b-4bd4-a916-6818bc6d0d5e" returned: 0 in 0.293s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] Lock "cinder-quobyte-2aab4fec-040b-4bd4-a916-6818bc6d0d5e" released by "delete_volume" :: held 0.750s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] Created reservations ['1e3cb63d-989c-40c8-8242-fe725835f990', '48102055-32ce-42f4-9740-ebfa00bb167a', 'ecd6f085-453b-4485-86b4-254d2cbe5fca', '20803be4-f066-4a50-a0bf-b927be1fb0aa'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:55 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:16:55 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:56 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.258s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:56 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:56 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] Deleted volume successfully. Jul 21 19:16:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1087644e-dede-4c13-9236-4af8e97c22e9 tempest-VolumeDependencyTests-195774688 None] Lock "cinder-2aab4fec-040b-4bd4-a916-6818bc6d0d5e-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:16:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:56 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:16:56 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:57 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.296s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:16:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:16:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:17:05 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=32,cinder:SELECT=19,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:17:06 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=17,cinder:DELETE=3,cinder:SELECT=18,cinder:INSERT=6 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:17:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-ce472d10-4355-4dc0-bcd2-84fa7c7cace9 req-8f955c54-363c-427e-9dd5-7e664cd87d2a tempest-TestStampPattern-1751917379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-ce472d10-4355-4dc0-bcd2-84fa7c7cace9 req-8f955c54-363c-427e-9dd5-7e664cd87d2a tempest-TestStampPattern-1751917379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:09 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b386589-34be-4928-84f6-5535dd1d48f1]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-ce472d10-4355-4dc0-bcd2-84fa7c7cace9 req-8f955c54-363c-427e-9dd5-7e664cd87d2a tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:09 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379 Jul 21 19:17:09 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:09 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [req-ce472d10-4355-4dc0-bcd2-84fa7c7cace9 req-8f955c54-363c-427e-9dd5-7e664cd87d2a tempest-TestStampPattern-1751917379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379" returned: 0 in 0.423s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [req-ce472d10-4355-4dc0-bcd2-84fa7c7cace9 req-8f955c54-363c-427e-9dd5-7e664cd87d2a tempest-TestStampPattern-1751917379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.453s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-ce472d10-4355-4dc0-bcd2-84fa7c7cace9 req-8f955c54-363c-427e-9dd5-7e664cd87d2a tempest-TestStampPattern-1751917379 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933', 'name': 'volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c94ab3d4-3faf-4333-999e-f09ea6c08e9c', 'enforce_multipath': True} {{(pid=87570) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:17:09 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-ce472d10-4355-4dc0-bcd2-84fa7c7cace9 req-8f955c54-363c-427e-9dd5-7e664cd87d2a tempest-TestStampPattern-1751917379 None] attachment_update completed successfully. Jul 21 19:17:12 devstack cinder-volume[87570]: INFO cinder.volume.manager [req-8ec9a99d-47d4-4ce0-88eb-7280622dab00 req-b600d406-0642-4bfc-a33b-eb4b8f9caaf2 tempest-TestStampPattern-1751917379 None] Terminate volume connection completed successfully. Jul 21 19:17:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [req-8ec9a99d-47d4-4ce0-88eb-7280622dab00 req-b600d406-0642-4bfc-a33b-eb4b8f9caaf2 tempest-TestStampPattern-1751917379 None] Deleting attachment c94ab3d4-3faf-4333-999e-f09ea6c08e9c. {{(pid=87570) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:17:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] Acquiring lock "cinder-ac113c3e-ce36-431b-aca3-73ebf6dc9379-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] Lock "cinder-ac113c3e-ce36-431b-aca3-73ebf6dc9379-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] Acquiring lock "cinder-quobyte-ac113c3e-ce36-431b-aca3-73ebf6dc9379" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] Lock "cinder-quobyte-ac113c3e-ce36-431b-aca3-73ebf6dc9379" acquired by "delete_volume" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:17 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f5cd36-9bdd-437c-8be5-7f450167af05]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:17 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379 Jul 21 19:17:17 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:17 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379" returned: 0 in 0.364s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:17 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379 Jul 21 19:17:17 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:17 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ac113c3e-ce36-431b-aca3-73ebf6dc9379" returned: 0 in 0.282s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] Lock "cinder-quobyte-ac113c3e-ce36-431b-aca3-73ebf6dc9379" released by "delete_volume" :: held 0.687s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:17 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] Created reservations ['aaa8d993-bffd-497f-9515-4e46c2f55e43', 'ff681ca0-4c66-4e37-9598-59a72c4d6d0c', 'be697eaa-889c-427a-8394-a99dfe4cfc74', 'bc8a66a8-18c9-4e85-8a27-2ae2dc516bdc'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:18 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:17:18 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:18 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.252s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:18 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:18 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] Deleted volume successfully. Jul 21 19:17:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6cc3ca52-63b3-4506-88c4-3674c1d7fe37 tempest-TestStampPattern-1751917379 None] Lock "cinder-ac113c3e-ce36-431b-aca3-73ebf6dc9379-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] Acquiring lock "cinder-b018f538-f6cc-415d-8ff2-a0a0e2d076b9-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] Lock "cinder-b018f538-f6cc-415d-8ff2-a0a0e2d076b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] Acquiring lock "cinder-quobyte-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] Lock "cinder-quobyte-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] Acquiring lock "cinder-quobyte-b018f538-f6cc-415d-8ff2-a0a0e2d076b9" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] Lock "cinder-quobyte-b018f538-f6cc-415d-8ff2-a0a0e2d076b9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] Deleting offline snapshot b018f538-f6cc-415d-8ff2-a0a0e2d076b9 of volume c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:17:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] snapshot_file for this snap is: volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:17:18 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47f5e7a-ec71-4931-849e-fa96868f0991]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:18 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9 Jul 21 19:17:18 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:19 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9" returned: 0 in 0.358s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:19 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:17:19 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8c57ca-8e34-46a8-83b5-61cc86f7294b]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:19 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 Jul 21 19:17:19 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:19 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0" returned: 0 in 0.355s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:19 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9 Jul 21 19:17:19 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:19 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9" returned: 0 in 0.332s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:19 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9 Jul 21 19:17:19 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:19 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0.b018f538-f6cc-415d-8ff2-a0a0e2d076b9" returned: 0 in 0.238s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] Lock "cinder-quobyte-b018f538-f6cc-415d-8ff2-a0a0e2d076b9" released by "_delete_snapshot" :: held 1.378s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] Lock "cinder-quobyte-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0" released by "delete_snapshot" :: held 1.400s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:20 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] Created reservations ['785ecbe4-03dc-4b3e-b55f-820fa95f1815', '3ef0705a-ce3f-47a7-96d4-8d69c5f20115', '403755a2-03a5-4859-974e-eb33ba1d2daf', '6feb2748-60cf-4c6e-a8db-ffb0f737776f'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:20 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] Delete snapshot completed successfully. Jul 21 19:17:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6d72259d-e40f-4ca7-ade9-eafb5f10a771 tempest-TestStampPattern-1751917379 None] Lock "cinder-b018f538-f6cc-415d-8ff2-a0a0e2d076b9-delete_snapshot" released by "delete_snapshot" :: held 1.530s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] Acquiring lock "cinder-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] Lock "cinder-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] Acquiring lock "cinder-quobyte-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] Lock "cinder-quobyte-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0" acquired by "delete_volume" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:24 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d6accb-eb99-4659-8f23-667384157a0d]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:24 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 Jul 21 19:17:24 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:24 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0" returned: 0 in 0.360s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:24 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0 Jul 21 19:17:24 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:24 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0" returned: 0 in 0.251s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] Lock "cinder-quobyte-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0" released by "delete_volume" :: held 0.669s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:25 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] Created reservations ['da999cd3-aac3-4083-90a0-24962a37e88c', '6d459d11-5007-4890-8afc-a614e4dd2a9b', 'c9000923-d148-49a7-8eb3-3542649e3a1e', 'a86d8db6-13d4-44fd-8f77-5d025e7c2a8b'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:25 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:17:25 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:25 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.266s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:25 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:25 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] Deleted volume successfully. Jul 21 19:17:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-97302d21-c32f-4b68-bced-a3a259ee1f99 tempest-TestStampPattern-1751917379 None] Lock "cinder-c3f1d030-39e9-4399-bb44-cc8b45cdf1c0-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:35 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=23,cinder:UPDATE=24,cinder:INSERT=7 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:17:35 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=23,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Flow 'volume_create_manager' (337caf80-9944-48ea-90b5-8598920a9ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02ede418-2cc5-465a-a530-19c7b9c14695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02ede418-2cc5-465a-a530-19c7b9c14695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1082999781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc71e8c-a051-4235-a46e-f36b1babe8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fcddfd043064dffae31b1e3bfa0d814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:37Z,use_quota=True,user_id='cfe556182ed1413b8e241ac6859d08c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c93b3c-f627-47ec-9b63-e9ff066e76c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c93b3c-f627-47ec-9b63-e9ff066e76c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a07da2-ac7a-4d17-87c3-7dc5a9d2d254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a07da2-ac7a-4d17-87c3-7dc5a9d2d254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cc71e8c-a051-4235-a46e-f36b1babe8cc', 'volume_name': 'volume-0cc71e8c-a051-4235-a46e-f36b1babe8cc', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24aef82-b534-4c7b-bed1-fb88b9463adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24aef82-b534-4c7b-bed1-fb88b9463adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3a60c2-25cd-41a0-aad1-6d6fd982f36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:37 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Volume 0cc71e8c-a051-4235-a46e-f36b1babe8cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cc71e8c-a051-4235-a46e-f36b1babe8cc', 'volume_size': 1} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1082999781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc71e8c-a051-4235-a46e-f36b1babe8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fcddfd043064dffae31b1e3bfa0d814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:37Z,use_quota=True,user_id='cfe556182ed1413b8e241ac6859d08c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Creating volume 0cc71e8c-a051-4235-a46e-f36b1babe8cc {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:37 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0cc71e8c-a051-4235-a46e-f36b1babe8cc 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:37 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0cc71e8c-a051-4235-a46e-f36b1babe8cc 1073741824 Jul 21 19:17:37 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:37 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0cc71e8c-a051-4235-a46e-f36b1babe8cc 1073741824" returned: 0 in 0.439s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0cc71e8c-a051-4235-a46e-f36b1babe8cc {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:38 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0cc71e8c-a051-4235-a46e-f36b1babe8cc Jul 21 19:17:38 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:38 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0cc71e8c-a051-4235-a46e-f36b1babe8cc" returned: 0 in 0.256s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3a60c2-25cd-41a0-aad1-6d6fd982f36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cc71e8c-a051-4235-a46e-f36b1babe8cc', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97f98ba-983c-447a-8fa5-12198c55b91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:38 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Volume volume-0cc71e8c-a051-4235-a46e-f36b1babe8cc (0cc71e8c-a051-4235-a46e-f36b1babe8cc): created successfully Jul 21 19:17:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97f98ba-983c-447a-8fa5-12198c55b91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:38 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Flow 'volume_create_manager' (337caf80-9944-48ea-90b5-8598920a9ca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:38 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-248187f6-fdd5-48cd-ba39-321e4699d06f tempest-ProjectReaderTests-1602032060 None] Created volume successfully. Jul 21 19:17:38 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] Acquiring lock "cinder-0cc71e8c-a051-4235-a46e-f36b1babe8cc-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:38 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] Lock "cinder-0cc71e8c-a051-4235-a46e-f36b1babe8cc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:38 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] Acquiring lock "cinder-quobyte-0cc71e8c-a051-4235-a46e-f36b1babe8cc" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:38 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] Lock "cinder-quobyte-0cc71e8c-a051-4235-a46e-f36b1babe8cc" acquired by "delete_volume" :: waited 0.019s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:38 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd567ab-c8f4-4db9-bdac-03bde540d483]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0cc71e8c-a051-4235-a46e-f36b1babe8cc {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:38 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0cc71e8c-a051-4235-a46e-f36b1babe8cc Jul 21 19:17:38 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:39 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0cc71e8c-a051-4235-a46e-f36b1babe8cc" returned: 0 in 0.416s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0cc71e8c-a051-4235-a46e-f36b1babe8cc {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:39 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0cc71e8c-a051-4235-a46e-f36b1babe8cc Jul 21 19:17:39 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:39 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-0cc71e8c-a051-4235-a46e-f36b1babe8cc" returned: 0 in 0.256s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] Lock "cinder-quobyte-0cc71e8c-a051-4235-a46e-f36b1babe8cc" released by "delete_volume" :: held 0.715s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:39 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] Created reservations ['e107c701-4012-4c25-afd6-8fe6850cb6cb', 'c0c3ec59-cf31-4fdf-8b6d-af1e61e2fee5', '5d25cfbf-90c0-4712-bb86-ebf321307e20', 'c090b34c-790c-4057-ba1b-e6336f700b14'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:39 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:17:39 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:39 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.277s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:39 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:39 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] Deleted volume successfully. Jul 21 19:17:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-c211a67f-f27c-4803-aeba-51ec2708a0ca tempest-ProjectReaderTests-1602032060 None] Lock "cinder-0cc71e8c-a051-4235-a46e-f36b1babe8cc-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Flow 'volume_create_manager' (6dff6494-81e9-4c03-911e-987b931c9d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7de49a-4c69-440c-850b-11bf073df9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7de49a-4c69-440c-850b-11bf073df9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1252086387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90eaa349-cd86-4df8-a699-78a046b82ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fcddfd043064dffae31b1e3bfa0d814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:40Z,use_quota=True,user_id='cfe556182ed1413b8e241ac6859d08c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2496c07e-2cfe-459d-8308-fc4c755ec582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2496c07e-2cfe-459d-8308-fc4c755ec582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd9819d-1504-4d13-8aa4-ed9c56efe8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd9819d-1504-4d13-8aa4-ed9c56efe8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90eaa349-cd86-4df8-a699-78a046b82ac5', 'volume_name': 'volume-90eaa349-cd86-4df8-a699-78a046b82ac5', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab129e6-5f6d-4d90-a72d-e695d69cf67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab129e6-5f6d-4d90-a72d-e695d69cf67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d035f611-38e8-4e20-8a3d-62d826834e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:40 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Volume 90eaa349-cd86-4df8-a699-78a046b82ac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90eaa349-cd86-4df8-a699-78a046b82ac5', 'volume_size': 1} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1252086387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90eaa349-cd86-4df8-a699-78a046b82ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fcddfd043064dffae31b1e3bfa0d814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:40Z,use_quota=True,user_id='cfe556182ed1413b8e241ac6859d08c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Creating volume 90eaa349-cd86-4df8-a699-78a046b82ac5 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:40 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-90eaa349-cd86-4df8-a699-78a046b82ac5 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:40 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-90eaa349-cd86-4df8-a699-78a046b82ac5 1073741824 Jul 21 19:17:40 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:40 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-90eaa349-cd86-4df8-a699-78a046b82ac5 1073741824" returned: 0 in 0.444s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-90eaa349-cd86-4df8-a699-78a046b82ac5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:40 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-90eaa349-cd86-4df8-a699-78a046b82ac5 Jul 21 19:17:40 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:41 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-90eaa349-cd86-4df8-a699-78a046b82ac5" returned: 0 in 0.257s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d035f611-38e8-4e20-8a3d-62d826834e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90eaa349-cd86-4df8-a699-78a046b82ac5', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc17d467-bbbe-4d3c-9636-1937324f2737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:41 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Volume volume-90eaa349-cd86-4df8-a699-78a046b82ac5 (90eaa349-cd86-4df8-a699-78a046b82ac5): created successfully Jul 21 19:17:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc17d467-bbbe-4d3c-9636-1937324f2737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Flow 'volume_create_manager' (6dff6494-81e9-4c03-911e-987b931c9d52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:41 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0c0e1241-beb0-4bb8-8691-d4190903f790 tempest-ProjectReaderTests-1602032060 None] Created volume successfully. Jul 21 19:17:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] Acquiring lock "cinder-90eaa349-cd86-4df8-a699-78a046b82ac5-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] Lock "cinder-90eaa349-cd86-4df8-a699-78a046b82ac5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] Acquiring lock "cinder-quobyte-90eaa349-cd86-4df8-a699-78a046b82ac5" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] Lock "cinder-quobyte-90eaa349-cd86-4df8-a699-78a046b82ac5" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:41 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d0ea4f-2c03-499f-b9b2-25caec55e579]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-90eaa349-cd86-4df8-a699-78a046b82ac5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:41 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-90eaa349-cd86-4df8-a699-78a046b82ac5 Jul 21 19:17:41 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:41 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-90eaa349-cd86-4df8-a699-78a046b82ac5" returned: 0 in 0.349s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-90eaa349-cd86-4df8-a699-78a046b82ac5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:41 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-90eaa349-cd86-4df8-a699-78a046b82ac5 Jul 21 19:17:41 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:42 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-90eaa349-cd86-4df8-a699-78a046b82ac5" returned: 0 in 0.239s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] Lock "cinder-quobyte-90eaa349-cd86-4df8-a699-78a046b82ac5" released by "delete_volume" :: held 0.626s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:42 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] Created reservations ['fff75ee8-fe2f-4129-aabc-fbe2026003da', 'cc949076-8a61-4106-9c5d-83737d14c701', '7a29ed7a-2e09-411f-81e4-a00ae04d7a78', '3c6ab851-3803-41fd-b790-ec055ae99351'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:42 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:17:42 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:42 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.247s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:42 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:42 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] Deleted volume successfully. Jul 21 19:17:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-54c03197-fd6c-4edd-ad54-c00598a7abc1 tempest-ProjectReaderTests-1602032060 None] Lock "cinder-90eaa349-cd86-4df8-a699-78a046b82ac5-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:52 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=19,cinder:SELECT=12,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:17:52 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=16,cinder:UPDATE=25,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Flow 'volume_create_manager' (65571586-a305-40bc-94f5-54f8578d2619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce82379b-f3d0-4f17-ab78-99876b4a9dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce82379b-f3d0-4f17-ab78-99876b4a9dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1535919666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3301aee-77ca-4dd2-bd73-955a56a2a1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45164aa6c3f4035960db0963ed46735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:55Z,use_quota=True,user_id='e7f091f5bab84155b788460391ed2d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95ebf3c-c1b9-4850-a090-4a9ddcf2b172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95ebf3c-c1b9-4850-a090-4a9ddcf2b172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54522c9-732c-472e-9bd4-d19646aecdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54522c9-732c-472e-9bd4-d19646aecdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3301aee-77ca-4dd2-bd73-955a56a2a1ef', 'volume_name': 'volume-b3301aee-77ca-4dd2-bd73-955a56a2a1ef', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd85432b-cdf3-463c-bb70-8bd574c23a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd85432b-cdf3-463c-bb70-8bd574c23a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d50619-cc87-4e37-8181-8f8af2b0dbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Volume b3301aee-77ca-4dd2-bd73-955a56a2a1ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3301aee-77ca-4dd2-bd73-955a56a2a1ef', 'volume_size': 1} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1535919666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3301aee-77ca-4dd2-bd73-955a56a2a1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45164aa6c3f4035960db0963ed46735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:55Z,use_quota=True,user_id='e7f091f5bab84155b788460391ed2d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Creating volume b3301aee-77ca-4dd2-bd73-955a56a2a1ef {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:54 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:17:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b3301aee-77ca-4dd2-bd73-955a56a2a1ef 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:54 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b3301aee-77ca-4dd2-bd73-955a56a2a1ef 1073741824 Jul 21 19:17:54 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Flow 'volume_create_manager' (d107fa99-54e5-4b99-b3d7-725346a7679c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e02f8c-80e8-4a4f-8c63-e41615f42d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e02f8c-80e8-4a4f-8c63-e41615f42d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1095548714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11da287ecb5343caa7d6fff8b155e15d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:55Z,use_quota=True,user_id='0534078ae59c41e5ab2b309571f4860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7657823e-efc9-406c-bd18-44b34665c1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7657823e-efc9-406c-bd18-44b34665c1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a9e38c-9cbb-4930-a29d-126258ce3982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a9e38c-9cbb-4930-a29d-126258ce3982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4', 'volume_name': 'volume-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e1692d-99f9-40d0-a768-5aa1d93ee919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e1692d-99f9-40d0-a768-5aa1d93ee919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55192f1c-0048-42c5-bf99-33b2cbbf85ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:55 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4', 'volume_size': 1} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Flow 'volume_create_manager' (631e31bb-1176-43a6-828e-6a1356ab24c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae419e16-5c17-4a85-87ae-e4bdaf53aa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae419e16-5c17-4a85-87ae-e4bdaf53aa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1611411397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7992639-0c08-4921-aa98-b50193c9d72a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45164aa6c3f4035960db0963ed46735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:56Z,use_quota=True,user_id='e7f091f5bab84155b788460391ed2d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c30986-27c8-4eb2-819f-b8eb0e037f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c30986-27c8-4eb2-819f-b8eb0e037f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affa23fa-ef02-4083-bd96-7c00386a6519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:55 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affa23fa-ef02-4083-bd96-7c00386a6519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7992639-0c08-4921-aa98-b50193c9d72a', 'volume_name': 'volume-d7992639-0c08-4921-aa98-b50193c9d72a', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f427b19-dbbd-49b0-b730-1f1ed7eeadaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f427b19-dbbd-49b0-b730-1f1ed7eeadaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e95c4d5-b1c6-4fac-bb6b-e465ac3f3e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:55 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Volume d7992639-0c08-4921-aa98-b50193c9d72a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7992639-0c08-4921-aa98-b50193c9d72a', 'volume_size': 1} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b3301aee-77ca-4dd2-bd73-955a56a2a1ef 1073741824" returned: 0 in 0.938s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b3301aee-77ca-4dd2-bd73-955a56a2a1ef {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:55 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b3301aee-77ca-4dd2-bd73-955a56a2a1ef Jul 21 19:17:55 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Flow 'volume_create_manager' (3b2e575f-3921-495f-9fba-9ba3fc97a2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6988fb3-a96a-4e19-bbf7-a5a013ba69fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6988fb3-a96a-4e19-bbf7-a5a013ba69fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2135346695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e75f33a-0bf4-4d51-8425-d6894256bdf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8c49769234428caa7e6c0bf5357ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:56Z,use_quota=True,user_id='d84cbe482dca4dac822f74f4f8110e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d688633e-f9ce-4b17-a34f-f1555fd344b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d688633e-f9ce-4b17-a34f-f1555fd344b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4411c2e-5d2b-4bc9-9f1a-3a4f74d77570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4411c2e-5d2b-4bc9-9f1a-3a4f74d77570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e75f33a-0bf4-4d51-8425-d6894256bdf3', 'volume_name': 'volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad54cb5c-927d-4ad4-9589-3c237d02f8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad54cb5c-927d-4ad4-9589-3c237d02f8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c68b60-cba2-44b7-b46b-48f5af094d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Volume 3e75f33a-0bf4-4d51-8425-d6894256bdf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3', 'volume_size': 1} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Flow 'volume_create_manager' (e19fc191-0625-4ec9-b13a-81abd3f48c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53aa5969-ea88-42f1-b444-a76a3f500fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b3301aee-77ca-4dd2-bd73-955a56a2a1ef" returned: 0 in 0.344s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1095548714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11da287ecb5343caa7d6fff8b155e15d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:55Z,use_quota=True,user_id='0534078ae59c41e5ab2b309571f4860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Creating volume f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:56 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53aa5969-ea88-42f1-b444-a76a3f500fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-783487419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=057554af-c448-4adf-b5e2-02a03db7b17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45164aa6c3f4035960db0963ed46735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:56Z,use_quota=True,user_id='e7f091f5bab84155b788460391ed2d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a275609-aeed-47fb-bf39-772a0b55ce5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a275609-aeed-47fb-bf39-772a0b55ce5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b228654b-cf5e-421b-8b61-d944da732aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4 1073741824 Jul 21 19:17:56 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b228654b-cf5e-421b-8b61-d944da732aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '057554af-c448-4adf-b5e2-02a03db7b17c', 'volume_name': 'volume-057554af-c448-4adf-b5e2-02a03db7b17c', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef17f875-634c-4da6-9293-6bef3cde1ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef17f875-634c-4da6-9293-6bef3cde1ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da35485-15d5-4d93-8d1f-5dc73dc0fcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Volume 057554af-c448-4adf-b5e2-02a03db7b17c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-057554af-c448-4adf-b5e2-02a03db7b17c', 'volume_size': 1} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d50619-cc87-4e37-8181-8f8af2b0dbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3301aee-77ca-4dd2-bd73-955a56a2a1ef', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c6b8a4-0575-4f3e-9ae5-96f001fad1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Volume volume-b3301aee-77ca-4dd2-bd73-955a56a2a1ef (b3301aee-77ca-4dd2-bd73-955a56a2a1ef): created successfully Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c6b8a4-0575-4f3e-9ae5-96f001fad1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Flow 'volume_create_manager' (65571586-a305-40bc-94f5-54f8578d2619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:56 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-77a44883-f759-4ef3-9b5d-a5bad8feb5d7 tempest-CreateVolumesFromImageTest-2034297617 None] Created volume successfully. Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Flow 'volume_create_manager' (277cf4a9-2761-443d-86a5-8caf2378a4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef75705-a61b-4453-898e-33f2f0c10cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef75705-a61b-4453-898e-33f2f0c10cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-943282190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2707c0f8-15b9-40d8-b5df-566d52b5f38b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45164aa6c3f4035960db0963ed46735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:57Z,use_quota=True,user_id='e7f091f5bab84155b788460391ed2d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f41132-5e4d-44d7-adea-3827c8aae6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f41132-5e4d-44d7-adea-3827c8aae6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d907cb-f02d-49ee-ba49-9e76d9b46ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d907cb-f02d-49ee-ba49-9e76d9b46ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2707c0f8-15b9-40d8-b5df-566d52b5f38b', 'volume_name': 'volume-2707c0f8-15b9-40d8-b5df-566d52b5f38b', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e71675dc-9ab0-4fe3-b570-7e1c8ebf598a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e71675dc-9ab0-4fe3-b570-7e1c8ebf598a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a5ab66-d2b7-4a9f-86e3-636785b2c2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Volume 2707c0f8-15b9-40d8-b5df-566d52b5f38b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2707c0f8-15b9-40d8-b5df-566d52b5f38b', 'volume_size': 1} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:56 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:17:56 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:57 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4 1073741824" returned: 0 in 0.758s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:57 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4 Jul 21 19:17:57 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:57 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.388s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Flow 'volume_create_manager' (4f70d079-8994-454d-ba50-28c5b17cc83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a636e0ac-a30d-4577-a88d-c8a8443d5659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a636e0ac-a30d-4577-a88d-c8a8443d5659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1629046472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7514552b-a226-4724-9ff4-66a3f57f10f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45164aa6c3f4035960db0963ed46735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:57Z,use_quota=True,user_id='e7f091f5bab84155b788460391ed2d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a85d49-6d26-4924-a9a3-7c6a96d1f900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a85d49-6d26-4924-a9a3-7c6a96d1f900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c1dd74-4c4e-4da0-bd68-187727eabd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c1dd74-4c4e-4da0-bd68-187727eabd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7514552b-a226-4724-9ff4-66a3f57f10f3', 'volume_name': 'volume-7514552b-a226-4724-9ff4-66a3f57f10f3', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b8374a-b188-42ba-afb1-467978a54038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b8374a-b188-42ba-afb1-467978a54038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19b4a82-0309-4585-a79e-f915beb09b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:57 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Volume 7514552b-a226-4724-9ff4-66a3f57f10f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7514552b-a226-4724-9ff4-66a3f57f10f3', 'volume_size': 1} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:57 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4" returned: 0 in 0.308s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.555s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1611411397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7992639-0c08-4921-aa98-b50193c9d72a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45164aa6c3f4035960db0963ed46735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:56Z,use_quota=True,user_id='e7f091f5bab84155b788460391ed2d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Creating volume d7992639-0c08-4921-aa98-b50193c9d72a {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:57 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d7992639-0c08-4921-aa98-b50193c9d72a 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55192f1c-0048-42c5-bf99-33b2cbbf85ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62673f60-8a6d-410c-8d91-dd900c869476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:57 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d7992639-0c08-4921-aa98-b50193c9d72a 1073741824 Jul 21 19:17:57 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:57 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume volume-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4 (f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4): created successfully Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62673f60-8a6d-410c-8d91-dd900c869476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Flow 'volume_create_manager' (d107fa99-54e5-4b99-b3d7-725346a7679c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:57 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-9b92eac6-a36b-47e8-acef-3abd80a613e0 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Created volume successfully. Jul 21 19:17:57 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d7992639-0c08-4921-aa98-b50193c9d72a 1073741824" returned: 0 in 0.512s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d7992639-0c08-4921-aa98-b50193c9d72a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:58 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d7992639-0c08-4921-aa98-b50193c9d72a Jul 21 19:17:58 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:58 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d7992639-0c08-4921-aa98-b50193c9d72a" returned: 0 in 0.295s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.116s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2135346695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e75f33a-0bf4-4d51-8425-d6894256bdf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8c49769234428caa7e6c0bf5357ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:56Z,use_quota=True,user_id='d84cbe482dca4dac822f74f4f8110e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Creating volume 3e75f33a-0bf4-4d51-8425-d6894256bdf3 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:58 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e95c4d5-b1c6-4fac-bb6b-e465ac3f3e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7992639-0c08-4921-aa98-b50193c9d72a', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:58 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 1073741824 Jul 21 19:17:58 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347acb0e-18de-462c-95e7-6374b2a6bac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:58 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Volume volume-d7992639-0c08-4921-aa98-b50193c9d72a (d7992639-0c08-4921-aa98-b50193c9d72a): created successfully Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347acb0e-18de-462c-95e7-6374b2a6bac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Flow 'volume_create_manager' (631e31bb-1176-43a6-828e-6a1356ab24c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:58 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-a769e58e-2ea2-48df-a05b-27795d4b28a9 tempest-CreateVolumesFromImageTest-2034297617 None] Created volume successfully. Jul 21 19:17:58 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 1073741824" returned: 0 in 0.490s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:58 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 Jul 21 19:17:58 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Flow 'volume_create_manager' (68bc857d-f730-4940-a877-1e33157cb544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1040efae-28ba-498a-bb03-8a511964fb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1040efae-28ba-498a-bb03-8a511964fb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1997808544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b13c0a-974f-4755-acef-4f34fbfb3022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11da287ecb5343caa7d6fff8b155e15d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:59Z,use_quota=True,user_id='0534078ae59c41e5ab2b309571f4860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03ec008-7848-4e97-8578-43f914cf778a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:59 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03ec008-7848-4e97-8578-43f914cf778a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c04b6f7-f937-4771-9ca7-db891f5ed182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c04b6f7-f937-4771-9ca7-db891f5ed182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54b13c0a-974f-4755-acef-4f34fbfb3022', 'volume_name': 'volume-54b13c0a-974f-4755-acef-4f34fbfb3022', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ffb671f-510c-423a-a22e-69aa1ecb978a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ffb671f-510c-423a-a22e-69aa1ecb978a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e30bd4-068a-46b6-bce1-0b72f7b67dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:59 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume 54b13c0a-974f-4755-acef-4f34fbfb3022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54b13c0a-974f-4755-acef-4f34fbfb3022', 'volume_size': 1} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3" returned: 0 in 0.418s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.882s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-783487419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=057554af-c448-4adf-b5e2-02a03db7b17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45164aa6c3f4035960db0963ed46735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:56Z,use_quota=True,user_id='e7f091f5bab84155b788460391ed2d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Creating volume 057554af-c448-4adf-b5e2-02a03db7b17c {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:59 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-057554af-c448-4adf-b5e2-02a03db7b17c 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c68b60-cba2-44b7-b46b-48f5af094d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a47a75b-17eb-432a-a6e4-d65c98e9ae2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:59 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-057554af-c448-4adf-b5e2-02a03db7b17c 1073741824 Jul 21 19:17:59 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:59 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Volume volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 (3e75f33a-0bf4-4d51-8425-d6894256bdf3): created successfully Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a47a75b-17eb-432a-a6e4-d65c98e9ae2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Flow 'volume_create_manager' (3b2e575f-3921-495f-9fba-9ba3fc97a2fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:59 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8eaf4e09-2d7b-4b21-a2b6-e2ef437f5ad5 tempest-VolumeDependencyTests-1979607568 None] Created volume successfully. Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Flow 'volume_create_manager' (c1d375bf-93f2-4579-b6e0-26536ae75f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7df0646-7526-4e8e-bf86-aa35a6531e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7df0646-7526-4e8e-bf86-aa35a6531e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-464399510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80626a65-5e58-4eae-b51f-e18b58012be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11da287ecb5343caa7d6fff8b155e15d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:00Z,use_quota=True,user_id='0534078ae59c41e5ab2b309571f4860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80de729b-086b-480e-884a-99cf8ed93a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80de729b-086b-480e-884a-99cf8ed93a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6b3ade-611c-45a5-9f00-94e1e9c54014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6b3ade-611c-45a5-9f00-94e1e9c54014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80626a65-5e58-4eae-b51f-e18b58012be5', 'volume_name': 'volume-80626a65-5e58-4eae-b51f-e18b58012be5', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b27a93-3ef5-4b3d-8d4c-b93d5c059b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b27a93-3ef5-4b3d-8d4c-b93d5c059b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77503b4b-35b1-4ed5-9c25-79087a28efc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:59 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume 80626a65-5e58-4eae-b51f-e18b58012be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80626a65-5e58-4eae-b51f-e18b58012be5', 'volume_size': 1} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:59 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-057554af-c448-4adf-b5e2-02a03db7b17c 1073741824" returned: 0 in 0.670s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-057554af-c448-4adf-b5e2-02a03db7b17c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:00 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-057554af-c448-4adf-b5e2-02a03db7b17c Jul 21 19:18:00 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:00 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-057554af-c448-4adf-b5e2-02a03db7b17c" returned: 0 in 0.359s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.577s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-943282190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2707c0f8-15b9-40d8-b5df-566d52b5f38b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45164aa6c3f4035960db0963ed46735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:57Z,use_quota=True,user_id='e7f091f5bab84155b788460391ed2d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Creating volume 2707c0f8-15b9-40d8-b5df-566d52b5f38b {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:00 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2707c0f8-15b9-40d8-b5df-566d52b5f38b 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:00 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2707c0f8-15b9-40d8-b5df-566d52b5f38b 1073741824 Jul 21 19:18:00 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da35485-15d5-4d93-8d1f-5dc73dc0fcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-057554af-c448-4adf-b5e2-02a03db7b17c', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3bb4250-384f-4c9f-9a6e-7367fd9a2b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Flow 'volume_create_manager' (322bf3e4-1c82-4839-958e-cdccec844ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400d7096-42d9-421a-9094-55e4055e6785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:00 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Volume volume-057554af-c448-4adf-b5e2-02a03db7b17c (057554af-c448-4adf-b5e2-02a03db7b17c): created successfully Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3bb4250-384f-4c9f-9a6e-7367fd9a2b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Flow 'volume_create_manager' (e19fc191-0625-4ec9-b13a-81abd3f48c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400d7096-42d9-421a-9094-55e4055e6785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-204552726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d903388-fe54-4fc5-8f47-42093ada8721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11da287ecb5343caa7d6fff8b155e15d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:00Z,use_quota=True,user_id='0534078ae59c41e5ab2b309571f4860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce5a1429-dcfb-475e-a540-36c258251d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce5a1429-dcfb-475e-a540-36c258251d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a95c52-bcc3-471d-9f3a-b473b1e45da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a95c52-bcc3-471d-9f3a-b473b1e45da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d903388-fe54-4fc5-8f47-42093ada8721', 'volume_name': 'volume-9d903388-fe54-4fc5-8f47-42093ada8721', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976d7360-b111-43ed-a916-84ffbb95340a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976d7360-b111-43ed-a916-84ffbb95340a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00133eff-9b6a-4520-b1cd-dd04d083aca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:00 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume 9d903388-fe54-4fc5-8f47-42093ada8721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d903388-fe54-4fc5-8f47-42093ada8721', 'volume_size': 1} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:00 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-2eba1f38-5e3a-42ac-aa0d-ee3fcc2605fc tempest-CreateVolumesFromImageTest-2034297617 None] Created volume successfully. Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Flow 'volume_create_manager' (4133179d-c9d6-418b-8b48-9bc340b1f795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c54dec-987d-41c1-a1e4-2498c8456946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c54dec-987d-41c1-a1e4-2498c8456946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7131f56-9382-4fa6-8263-52d6bb5b4c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ecfe770fd24613ae4b76a777be283f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:01Z,use_quota=True,user_id='8872d66d460c425b82d9d577a2625399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(059a5023-9246-478a-bca9-000a711425ba),volume_type_id=059a5023-9246-478a-bca9-000a711425ba)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e2befd-3f58-459b-b420-df994dd6c96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e2befd-3f58-459b-b420-df994dd6c96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf6b790-db0d-42d2-88fe-05d21e53cb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG cinder.image.glance [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Creating Keystone auth plugin from conf {{(pid=87570) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:18:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Flow 'volume_create_manager' (7442de3b-bf47-4ea7-9a15-0adf3e7a32d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2144bc86-829c-4c99-9272-4925675881d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:01 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2707c0f8-15b9-40d8-b5df-566d52b5f38b 1073741824" returned: 0 in 0.708s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2144bc86-829c-4c99-9272-4925675881d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-600341411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8d7a7e-228d-4255-905a-c266762a933f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11da287ecb5343caa7d6fff8b155e15d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:01Z,use_quota=True,user_id='0534078ae59c41e5ab2b309571f4860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7467bfc2-7bf9-4c6a-a594-7f9fb92e8f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7467bfc2-7bf9-4c6a-a594-7f9fb92e8f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8c2559-a480-4894-ab84-5ebee28dbf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8c2559-a480-4894-ab84-5ebee28dbf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba8d7a7e-228d-4255-905a-c266762a933f', 'volume_name': 'volume-ba8d7a7e-228d-4255-905a-c266762a933f', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcfa70d-1156-4b81-84e5-1ba313afbda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcfa70d-1156-4b81-84e5-1ba313afbda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7188c3a3-3367-423e-8fcb-5472be8061c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:01 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume ba8d7a7e-228d-4255-905a-c266762a933f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba8d7a7e-228d-4255-905a-c266762a933f', 'volume_size': 1} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2707c0f8-15b9-40d8-b5df-566d52b5f38b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:01 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2707c0f8-15b9-40d8-b5df-566d52b5f38b Jul 21 19:18:01 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Flow 'volume_create_manager' (b2bb4ce2-038c-4a85-a9e1-e00df6b106f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d90b1c5-d933-424b-b712-dbdfbb27d449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf6b790-db0d-42d2-88fe-05d21e53cb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e7131f56-9382-4fa6-8263-52d6bb5b4c7b', 'volume_name': 'volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b', 'volume_size': 1, 'image_id': '1e9b9631-6eaf-4812-aaf3-421352f222e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e9b9631-6eaf-4812-aaf3-421352f222e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '40f6d6692cc7b28655ab59e3662b498f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '85ecfe770fd24613ae4b76a777be283f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '59f98911119aa5c0dc7e05cdb8f156d905dbe93719159f052cfb0b38dab47532290b9c2946be61deb98b75bc34fd8a2c2ee2b48319e1f9b0d651641af31a5b02', 'id': '1e9b9631-6eaf-4812-aaf3-421352f222e0', 'created_at': datetime.datetime(2026, 7, 21, 17, 17, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 17, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e9b9631-6eaf-4812-aaf3-421352f222e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b32fe9-3515-4485-994d-9721f32ccdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b32fe9-3515-4485-994d-9721f32ccdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21e6798-6372-44e9-a503-b25920f6a760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:01 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Volume e7131f56-9382-4fa6-8263-52d6bb5b4c7b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b', 'volume_size': 1, 'image_id': '1e9b9631-6eaf-4812-aaf3-421352f222e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e9b9631-6eaf-4812-aaf3-421352f222e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '40f6d6692cc7b28655ab59e3662b498f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '85ecfe770fd24613ae4b76a777be283f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '59f98911119aa5c0dc7e05cdb8f156d905dbe93719159f052cfb0b38dab47532290b9c2946be61deb98b75bc34fd8a2c2ee2b48319e1f9b0d651641af31a5b02', 'id': '1e9b9631-6eaf-4812-aaf3-421352f222e0', 'created_at': datetime.datetime(2026, 7, 21, 17, 17, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 17, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e9b9631-6eaf-4812-aaf3-421352f222e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Trying to clone e7131f56-9382-4fa6-8263-52d6bb5b4c7b from image 1e9b9631-6eaf-4812-aaf3-421352f222e0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1e9b9631-6eaf-4812-aaf3-421352f222e0', 'metadata': {}}]). {{(pid=87570) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d90b1c5-d933-424b-b712-dbdfbb27d449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1421358176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e2ada3-37f3-4029-a006-16449111d5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11da287ecb5343caa7d6fff8b155e15d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:01Z,use_quota=True,user_id='0534078ae59c41e5ab2b309571f4860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf0d443-5276-4ca9-a223-c97bd8054cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf0d443-5276-4ca9-a223-c97bd8054cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015cbf71-23d1-4037-bbd6-f158f6f4f7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015cbf71-23d1-4037-bbd6-f158f6f4f7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e2ada3-37f3-4029-a006-16449111d5f9', 'volume_name': 'volume-a0e2ada3-37f3-4029-a006-16449111d5f9', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a0c33e-13d6-45d2-b171-3d734ae5f813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a0c33e-13d6-45d2-b171-3d734ae5f813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1640e4c7-3e05-498c-9bd4-632702e8af87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:01 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume a0e2ada3-37f3-4029-a006-16449111d5f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e2ada3-37f3-4029-a006-16449111d5f9', 'volume_size': 1} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:18:01 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Image download 0.00 MB at 0.00 MB/s Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[026ba2c6-58cc-4422-a2a4-bcf83c5d1d00]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:01 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2707c0f8-15b9-40d8-b5df-566d52b5f38b" returned: 0 in 0.296s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.226s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1629046472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7514552b-a226-4724-9ff4-66a3f57f10f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45164aa6c3f4035960db0963ed46735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:57Z,use_quota=True,user_id='e7f091f5bab84155b788460391ed2d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Creating volume 7514552b-a226-4724-9ff4-66a3f57f10f3 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:01 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7514552b-a226-4724-9ff4-66a3f57f10f3 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:01 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7514552b-a226-4724-9ff4-66a3f57f10f3 1073741824 Jul 21 19:18:01 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a5ab66-d2b7-4a9f-86e3-636785b2c2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2707c0f8-15b9-40d8-b5df-566d52b5f38b', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc74edcb-b463-4808-b3f1-e9c06f7db9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:01 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Volume volume-2707c0f8-15b9-40d8-b5df-566d52b5f38b (2707c0f8-15b9-40d8-b5df-566d52b5f38b): created successfully Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc74edcb-b463-4808-b3f1-e9c06f7db9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Flow 'volume_create_manager' (277cf4a9-2761-443d-86a5-8caf2378a4da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:01 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-03c0d8ab-486f-4830-9906-e5667eda9b66 tempest-CreateVolumesFromImageTest-2034297617 None] Created volume successfully. Jul 21 19:18:01 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD Jul 21 19:18:01 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:01 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:02 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7514552b-a226-4724-9ff4-66a3f57f10f3 1073741824" returned: 0 in 0.475s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:02 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD Jul 21 19:18:02 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7514552b-a226-4724-9ff4-66a3f57f10f3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:02 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7514552b-a226-4724-9ff4-66a3f57f10f3 Jul 21 19:18:02 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:02 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD" returned: 1 in 0.377s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Temporary image 1e9b9631-6eaf-4812-aaf3-421352f222e0 is fetched for user 8872d66d460c425b82d9d577a2625399. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:18:02 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7514552b-a226-4724-9ff4-66a3f57f10f3" returned: 0 in 0.277s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.140s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1997808544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b13c0a-974f-4755-acef-4f34fbfb3022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11da287ecb5343caa7d6fff8b155e15d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:59Z,use_quota=True,user_id='0534078ae59c41e5ab2b309571f4860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Creating volume 54b13c0a-974f-4755-acef-4f34fbfb3022 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:02 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-54b13c0a-974f-4755-acef-4f34fbfb3022 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:02 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-54b13c0a-974f-4755-acef-4f34fbfb3022 1073741824 Jul 21 19:18:02 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19b4a82-0309-4585-a79e-f915beb09b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7514552b-a226-4724-9ff4-66a3f57f10f3', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61430a4b-0207-40bf-ad32-43689d408c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:02 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Volume volume-7514552b-a226-4724-9ff4-66a3f57f10f3 (7514552b-a226-4724-9ff4-66a3f57f10f3): created successfully Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61430a4b-0207-40bf-ad32-43689d408c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Flow 'volume_create_manager' (4f70d079-8994-454d-ba50-28c5b17cc83f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[af824bd4-dce5-48bf-8a47-1a4a807ac0aa]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:02 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-6292a292-b007-4a46-b1e9-bc0982e6d401 tempest-CreateVolumesFromImageTest-2034297617 None] Created volume successfully. Jul 21 19:18:02 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD Jul 21 19:18:02 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:02 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-54b13c0a-974f-4755-acef-4f34fbfb3022 1073741824" returned: 0 in 0.454s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:02 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-54b13c0a-974f-4755-acef-4f34fbfb3022 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:02 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-54b13c0a-974f-4755-acef-4f34fbfb3022 Jul 21 19:18:02 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:02 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD Jul 21 19:18:02 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:03 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-54b13c0a-974f-4755-acef-4f34fbfb3022" returned: 0 in 0.266s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.395s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-464399510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80626a65-5e58-4eae-b51f-e18b58012be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11da287ecb5343caa7d6fff8b155e15d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:00Z,use_quota=True,user_id='0534078ae59c41e5ab2b309571f4860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Creating volume 80626a65-5e58-4eae-b51f-e18b58012be5 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:03 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-80626a65-5e58-4eae-b51f-e18b58012be5 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e30bd4-068a-46b6-bce1-0b72f7b67dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54b13c0a-974f-4755-acef-4f34fbfb3022', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb2c17f2-b625-41c9-9da9-2af66561e599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:03 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-80626a65-5e58-4eae-b51f-e18b58012be5 1073741824 Jul 21 19:18:03 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:03 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume volume-54b13c0a-974f-4755-acef-4f34fbfb3022 (54b13c0a-974f-4755-acef-4f34fbfb3022): created successfully Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb2c17f2-b625-41c9-9da9-2af66561e599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Flow 'volume_create_manager' (68bc857d-f730-4940-a877-1e33157cb544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:03 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:03 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-93a3b009-4e62-424d-bfa6-2b794c337058 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Created volume successfully. Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "cinder-7514552b-a226-4724-9ff4-66a3f57f10f3-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-7514552b-a226-4724-9ff4-66a3f57f10f3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "cinder-quobyte-7514552b-a226-4724-9ff4-66a3f57f10f3" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-quobyte-7514552b-a226-4724-9ff4-66a3f57f10f3" acquired by "delete_volume" :: waited 0.024s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83d49b4-ffe6-4a4b-8780-a8d344eec5a0]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7514552b-a226-4724-9ff4-66a3f57f10f3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:03 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-80626a65-5e58-4eae-b51f-e18b58012be5 1073741824" returned: 0 in 0.639s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-80626a65-5e58-4eae-b51f-e18b58012be5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:03 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7514552b-a226-4724-9ff4-66a3f57f10f3 Jul 21 19:18:03 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:03 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-80626a65-5e58-4eae-b51f-e18b58012be5 Jul 21 19:18:03 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:04 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-80626a65-5e58-4eae-b51f-e18b58012be5" returned: 0 in 0.265s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.473s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-204552726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d903388-fe54-4fc5-8f47-42093ada8721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11da287ecb5343caa7d6fff8b155e15d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:00Z,use_quota=True,user_id='0534078ae59c41e5ab2b309571f4860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Creating volume 9d903388-fe54-4fc5-8f47-42093ada8721 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:04 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d903388-fe54-4fc5-8f47-42093ada8721 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:04 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7514552b-a226-4724-9ff4-66a3f57f10f3" returned: 0 in 0.451s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7514552b-a226-4724-9ff4-66a3f57f10f3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:04 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d903388-fe54-4fc5-8f47-42093ada8721 1073741824 Jul 21 19:18:04 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77503b4b-35b1-4ed5-9c25-79087a28efc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80626a65-5e58-4eae-b51f-e18b58012be5', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae0c956-22a7-4884-b8b0-71f7f1ed253e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:04 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7514552b-a226-4724-9ff4-66a3f57f10f3 Jul 21 19:18:04 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:04 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume volume-80626a65-5e58-4eae-b51f-e18b58012be5 (80626a65-5e58-4eae-b51f-e18b58012be5): created successfully Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae0c956-22a7-4884-b8b0-71f7f1ed253e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Flow 'volume_create_manager' (c1d375bf-93f2-4579-b6e0-26536ae75f4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:04 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-b874c849-7f41-4be5-b900-30a180a41145 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Created volume successfully. Jul 21 19:18:04 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7514552b-a226-4724-9ff4-66a3f57f10f3" returned: 0 in 0.359s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-quobyte-7514552b-a226-4724-9ff4-66a3f57f10f3" released by "delete_volume" :: held 0.865s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] Created reservations ['36ad0d29-cb5a-4e42-a51e-3d75db0b2e4b', '9524b6cd-09d7-4a4f-8443-6130434970ca', '44a9e5e3-4bd0-4f1b-b160-43cd78ba5cf4', '1605161a-1871-4349-ab7e-fd6366122659'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:04 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:04 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:04 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d903388-fe54-4fc5-8f47-42093ada8721 1073741824" returned: 0 in 0.591s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "cinder-2707c0f8-15b9-40d8-b5df-566d52b5f38b-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d903388-fe54-4fc5-8f47-42093ada8721 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-2707c0f8-15b9-40d8-b5df-566d52b5f38b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:04 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d903388-fe54-4fc5-8f47-42093ada8721 Jul 21 19:18:04 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "cinder-quobyte-2707c0f8-15b9-40d8-b5df-566d52b5f38b" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-quobyte-2707c0f8-15b9-40d8-b5df-566d52b5f38b" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d82710f-3c97-493e-a403-303fcb1148ee]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2707c0f8-15b9-40d8-b5df-566d52b5f38b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:05 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.331s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:05 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] Deleted volume successfully. Jul 21 19:18:05 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2707c0f8-15b9-40d8-b5df-566d52b5f38b Jul 21 19:18:05 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0f810a2d-2651-4718-875f-239c0df7ebbb tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-7514552b-a226-4724-9ff4-66a3f57f10f3-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:05 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d903388-fe54-4fc5-8f47-42093ada8721" returned: 0 in 0.298s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.233s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00133eff-9b6a-4520-b1cd-dd04d083aca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d903388-fe54-4fc5-8f47-42093ada8721', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1498c0-436e-4d5b-8b87-f59359ed2a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] Creating offline snapshot 7122e721-f550-4954-bee6-2158e47acb35 of volume 3e75f33a-0bf4-4d51-8425-d6894256bdf3 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:18:05 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume volume-9d903388-fe54-4fc5-8f47-42093ada8721 (9d903388-fe54-4fc5-8f47-42093ada8721): created successfully Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1498c0-436e-4d5b-8b87-f59359ed2a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Flow 'volume_create_manager' (322bf3e4-1c82-4839-958e-cdccec844ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e0b6e6-6a3d-4d39-b83c-97f0b0322a51]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:05 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-5f5754c9-dbed-4c9f-bcab-303b71cc7912 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Created volume successfully. Jul 21 19:18:05 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 Jul 21 19:18:05 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:05 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2707c0f8-15b9-40d8-b5df-566d52b5f38b" returned: 0 in 0.407s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2707c0f8-15b9-40d8-b5df-566d52b5f38b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:05 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2707c0f8-15b9-40d8-b5df-566d52b5f38b Jul 21 19:18:05 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:05 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3" returned: 0 in 0.454s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:05 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2707c0f8-15b9-40d8-b5df-566d52b5f38b" returned: 0 in 0.303s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-quobyte-2707c0f8-15b9-40d8-b5df-566d52b5f38b" released by "delete_volume" :: held 0.759s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:05 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35 1G Jul 21 19:18:05 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] Created reservations ['1b0915aa-9909-423f-8140-0f117aa48c9c', '599cbfa5-8346-4d14-a544-d00106c48c61', '8f4d3ec6-3911-4bb4-91b1-b1207edc91a9', 'c84de288-81ca-4cf5-8db1-b3744e87e3ea'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:05 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:05 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "cinder-057554af-c448-4adf-b5e2-02a03db7b17c-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-057554af-c448-4adf-b5e2-02a03db7b17c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "cinder-quobyte-057554af-c448-4adf-b5e2-02a03db7b17c" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:06 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.320s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-quobyte-057554af-c448-4adf-b5e2-02a03db7b17c" acquired by "delete_volume" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:06 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] Deleted volume successfully. Jul 21 19:18:06 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35 1G" returned: 0 in 0.511s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaf415d-34d2-4372-91df-8fae2e9ef64d]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-057554af-c448-4adf-b5e2-02a03db7b17c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:06 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35 Jul 21 19:18:06 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0efca0e5-e4ea-44ea-a3f1-6bc4f9e20078 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-2707c0f8-15b9-40d8-b5df-566d52b5f38b-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:06 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-057554af-c448-4adf-b5e2-02a03db7b17c Jul 21 19:18:06 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:06 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35" returned: 0 in 0.307s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:06 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35 is being set with open permissions: ugo+rw Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:06 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35 Jul 21 19:18:06 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:06 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-057554af-c448-4adf-b5e2-02a03db7b17c" returned: 0 in 0.392s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-057554af-c448-4adf-b5e2-02a03db7b17c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:06 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-057554af-c448-4adf-b5e2-02a03db7b17c Jul 21 19:18:06 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:06 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35" returned: 0 in 0.294s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:06 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.info Jul 21 19:18:06 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:06 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-057554af-c448-4adf-b5e2-02a03db7b17c" returned: 0 in 0.265s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-quobyte-057554af-c448-4adf-b5e2-02a03db7b17c" released by "delete_volume" :: held 0.715s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] Created reservations ['a855287c-eeb0-4b5a-ad84-b12cbc4dec65', 'aa8bd035-44fa-454a-9f60-3b03239e7715', 'cbab61aa-f43b-4712-8ac9-530a8872af55', 'd4a946eb-12ee-425b-b6fd-74797a8607f9'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:06 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:06 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:07 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.info" returned: 0 in 0.259s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:07 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.info is being set with open permissions: ugo+rw Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:07 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.info Jul 21 19:18:07 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:07 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.264s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:07 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] Deleted volume successfully. Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "cinder-d7992639-0c08-4921-aa98-b50193c9d72a-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-aa1953ba-e61f-4445-b4f6-1fa6bfc68f3f tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-057554af-c448-4adf-b5e2-02a03db7b17c-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-d7992639-0c08-4921-aa98-b50193c9d72a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:07 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "cinder-quobyte-d7992639-0c08-4921-aa98-b50193c9d72a" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.info" returned: 0 in 0.268s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.136s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-600341411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8d7a7e-228d-4255-905a-c266762a933f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11da287ecb5343caa7d6fff8b155e15d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:01Z,use_quota=True,user_id='0534078ae59c41e5ab2b309571f4860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Creating volume ba8d7a7e-228d-4255-905a-c266762a933f {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:07 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ba8d7a7e-228d-4255-905a-c266762a933f 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:07 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ba8d7a7e-228d-4255-905a-c266762a933f 1073741824 Jul 21 19:18:07 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-quobyte-d7992639-0c08-4921-aa98-b50193c9d72a" acquired by "delete_volume" :: waited 0.057s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[975aa789-ac20-41b2-a2dd-4069f95a0c9e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d7992639-0c08-4921-aa98-b50193c9d72a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:07 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-6e261595-14f0-4316-95cc-c23a1a287263 tempest-VolumeDependencyTests-1979607568 None] Create snapshot completed successfully Jul 21 19:18:07 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d7992639-0c08-4921-aa98-b50193c9d72a Jul 21 19:18:07 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:07 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ba8d7a7e-228d-4255-905a-c266762a933f 1073741824" returned: 0 in 0.452s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:07 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d7992639-0c08-4921-aa98-b50193c9d72a" returned: 0 in 0.414s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d7992639-0c08-4921-aa98-b50193c9d72a {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:07 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d7992639-0c08-4921-aa98-b50193c9d72a Jul 21 19:18:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ba8d7a7e-228d-4255-905a-c266762a933f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:07 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:07 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ba8d7a7e-228d-4255-905a-c266762a933f Jul 21 19:18:07 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:08 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ba8d7a7e-228d-4255-905a-c266762a933f" returned: 0 in 0.251s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.679s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1421358176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e2ada3-37f3-4029-a006-16449111d5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11da287ecb5343caa7d6fff8b155e15d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:01Z,use_quota=True,user_id='0534078ae59c41e5ab2b309571f4860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Creating volume a0e2ada3-37f3-4029-a006-16449111d5f9 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:08 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:08 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a0e2ada3-37f3-4029-a006-16449111d5f9 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7188c3a3-3367-423e-8fcb-5472be8061c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8d7a7e-228d-4255-905a-c266762a933f', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2456547d-3bf0-40cd-8a0b-7b77cad248ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:08 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a0e2ada3-37f3-4029-a006-16449111d5f9 1073741824 Jul 21 19:18:08 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-d7992639-0c08-4921-aa98-b50193c9d72a" returned: 0 in 0.343s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-quobyte-d7992639-0c08-4921-aa98-b50193c9d72a" released by "delete_volume" :: held 0.813s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:08 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume volume-ba8d7a7e-228d-4255-905a-c266762a933f (ba8d7a7e-228d-4255-905a-c266762a933f): created successfully Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2456547d-3bf0-40cd-8a0b-7b77cad248ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Flow 'volume_create_manager' (7442de3b-bf47-4ea7-9a15-0adf3e7a32d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:08 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-90bba78e-a78c-4d78-b31a-e2e56a9b0326 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Created volume successfully. Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] Created reservations ['ded6f9f1-56d0-4a7d-b078-27d1ebcb7629', 'c6420548-5f3b-46da-82bc-6e811c4dca04', 'eecaca0c-59b7-4e65-a3b9-59b712a36c7b', 'c3d1e32d-c49a-49d9-a0a4-4b9f1149c408'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:08 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:08 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "cinder-b3301aee-77ca-4dd2-bd73-955a56a2a1ef-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-b3301aee-77ca-4dd2-bd73-955a56a2a1ef-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Flow 'volume_create_manager' (1dccbf45-4942-4c6b-a019-bb755f051eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e35b77ea-7957-4fdb-8557-f84ecc953f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "cinder-quobyte-b3301aee-77ca-4dd2-bd73-955a56a2a1ef" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e35b77ea-7957-4fdb-8557-f84ecc953f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1218616140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bfa031-f23a-44c3-8bfd-295689e3cc13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8c49769234428caa7e6c0bf5357ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7122e721-f550-4954-bee6-2158e47acb35,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:08Z,use_quota=True,user_id='d84cbe482dca4dac822f74f4f8110e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2745583a-ef6c-49e8-8375-4141ef6a0b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2745583a-ef6c-49e8-8375-4141ef6a0b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaefbe5f-f002-4842-b669-ce37d5f4f7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaefbe5f-f002-4842-b669-ce37d5f4f7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '35bfa031-f23a-44c3-8bfd-295689e3cc13', 'volume_name': 'volume-35bfa031-f23a-44c3-8bfd-295689e3cc13', 'volume_size': 1, 'snapshot_id': '7122e721-f550-4954-bee6-2158e47acb35'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f299488-8cce-4e41-b54c-1180beddfb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f299488-8cce-4e41-b54c-1180beddfb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48afc4e-a550-4d29-a7ce-5a0c6be6bfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:08 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Volume 35bfa031-f23a-44c3-8bfd-295689e3cc13: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-35bfa031-f23a-44c3-8bfd-295689e3cc13', 'volume_size': 1, 'snapshot_id': '7122e721-f550-4954-bee6-2158e47acb35'} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-quobyte-b3301aee-77ca-4dd2-bd73-955a56a2a1ef" acquired by "delete_volume" :: waited 0.064s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:08 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:08 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a0e2ada3-37f3-4029-a006-16449111d5f9 1073741824" returned: 0 in 0.585s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.345s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b277ce-2384-412d-b1a2-1815262ef61e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b3301aee-77ca-4dd2-bd73-955a56a2a1ef {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:08 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] Deleted volume successfully. Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-930e47b6-207f-4f12-a4e1-a108fc39dc84 tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-d7992639-0c08-4921-aa98-b50193c9d72a-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a0e2ada3-37f3-4029-a006-16449111d5f9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:08 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a0e2ada3-37f3-4029-a006-16449111d5f9 Jul 21 19:18:08 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:08 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b3301aee-77ca-4dd2-bd73-955a56a2a1ef Jul 21 19:18:08 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:09 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a0e2ada3-37f3-4029-a006-16449111d5f9" returned: 0 in 0.257s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.791s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7131f56-9382-4fa6-8263-52d6bb5b4c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ecfe770fd24613ae4b76a777be283f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:01Z,use_quota=True,user_id='8872d66d460c425b82d9d577a2625399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(059a5023-9246-478a-bca9-000a711425ba),volume_type_id=059a5023-9246-478a-bca9-000a711425ba)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Creating volume e7131f56-9382-4fa6-8263-52d6bb5b4c7b {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:09 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1640e4c7-3e05-498c-9bd4-632702e8af87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e2ada3-37f3-4029-a006-16449111d5f9', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:09 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b 1073741824 Jul 21 19:18:09 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86cab27-04f9-49e2-844a-2876c9b59f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:09 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Volume volume-a0e2ada3-37f3-4029-a006-16449111d5f9 (a0e2ada3-37f3-4029-a006-16449111d5f9): created successfully Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86cab27-04f9-49e2-844a-2876c9b59f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Flow 'volume_create_manager' (b2bb4ce2-038c-4a85-a9e1-e00df6b106f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:09 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-506d555d-bf9a-410e-b5f6-5276323dd4a2 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Created volume successfully. Jul 21 19:18:09 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b3301aee-77ca-4dd2-bd73-955a56a2a1ef" returned: 0 in 0.428s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b3301aee-77ca-4dd2-bd73-955a56a2a1ef {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:09 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b3301aee-77ca-4dd2-bd73-955a56a2a1ef Jul 21 19:18:09 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:09 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b3301aee-77ca-4dd2-bd73-955a56a2a1ef" returned: 0 in 0.262s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-quobyte-b3301aee-77ca-4dd2-bd73-955a56a2a1ef" released by "delete_volume" :: held 0.752s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] Created reservations ['7ee041bd-5103-4956-a90a-0006789de379', 'a3c6caf3-7508-4436-97ca-50dce2004a5a', '3114c425-bae4-4085-8bb8-2c1fbc7c1727', 'ec1fddc3-6ca5-4f1e-9566-8747ed2b6a81'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:09 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b 1073741824" returned: 0 in 0.451s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:09 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b Jul 21 19:18:09 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:09 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:09 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:09 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b" returned: 0 in 0.295s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:09 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.125s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Acquiring lock "cinder-quobyte-7122e721-f550-4954-bee6-2158e47acb35-35bfa031-f23a-44c3-8bfd-295689e3cc13" by "_create_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.271s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:09 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] Deleted volume successfully. Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-quobyte-7122e721-f550-4954-bee6-2158e47acb35-35bfa031-f23a-44c3-8bfd-295689e3cc13" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Creating volume 35bfa031-f23a-44c3-8bfd-295689e3cc13 from snapshot 7122e721-f550-4954-bee6-2158e47acb35 {{(pid=87570) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Acquiring lock "cinder-quobyte-35bfa031-f23a-44c3-8bfd-295689e3cc13" by "_copy_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Attempting download of 1e9b9631-6eaf-4812-aaf3-421352f222e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e9b9631-6eaf-4812-aaf3-421352f222e0', 'metadata': {}}])) to volume e7131f56-9382-4fa6-8263-52d6bb5b4c7b. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b1f536b9-57b6-4c56-9604-6b0f4c7620fb tempest-CreateVolumesFromImageTest-2034297617 None] Lock "cinder-b3301aee-77ca-4dd2-bd73-955a56a2a1ef-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-quobyte-35bfa031-f23a-44c3-8bfd-295689e3cc13" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] snapshot: 7122e721-f550-4954-bee6-2158e47acb35, volume: 35bfa031-f23a-44c3-8bfd-295689e3cc13, {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daa2c20-f0b5-4beb-8c37-9eb873422180]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[b021c857-46e1-4d7c-a777-5418e17b9367]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e9b9631-6eaf-4812-aaf3-421352f222e0_cvxup3mx {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "cinder-a0e2ada3-37f3-4029-a006-16449111d5f9-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-a0e2ada3-37f3-4029-a006-16449111d5f9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:10 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e9b9631-6eaf-4812-aaf3-421352f222e0_cvxup3mx Jul 21 19:18:10 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35 Jul 21 19:18:10 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:10 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "cinder-quobyte-a0e2ada3-37f3-4029-a006-16449111d5f9" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-quobyte-a0e2ada3-37f3-4029-a006-16449111d5f9" acquired by "delete_volume" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acef99e-70d9-47bd-9b05-bf50caecada1]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a0e2ada3-37f3-4029-a006-16449111d5f9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:10 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a0e2ada3-37f3-4029-a006-16449111d5f9 Jul 21 19:18:10 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:10 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e9b9631-6eaf-4812-aaf3-421352f222e0_cvxup3mx" returned: 0 in 0.443s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e9b9631-6eaf-4812-aaf3-421352f222e0_cvxup3mx {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:10 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35" returned: 0 in 0.447s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Creating direct copy from snapshot {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9079fa-b4d2-4673-84ce-bee1650221f0]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:10 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e9b9631-6eaf-4812-aaf3-421352f222e0_cvxup3mx Jul 21 19:18:10 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:10 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 Jul 21 19:18:10 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:10 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a0e2ada3-37f3-4029-a006-16449111d5f9" returned: 0 in 0.547s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a0e2ada3-37f3-4029-a006-16449111d5f9 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:10 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a0e2ada3-37f3-4029-a006-16449111d5f9 Jul 21 19:18:10 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:10 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e9b9631-6eaf-4812-aaf3-421352f222e0_cvxup3mx" returned: 1 in 0.505s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e9b9631-6eaf-4812-aaf3-421352f222e0_cvxup3mx' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca1e82e-5a6e-4f2f-9192-4d7055620476]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:11 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3" returned: 0 in 0.554s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:11 devstack cinder-volume[87570]: DEBUG cinder.utils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Path /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35bfa031-f23a-44c3-8bfd-295689e3cc13 not found in is_blk_device check {{(pid=87570) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:18:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35bfa031-f23a-44c3-8bfd-295689e3cc13 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:11 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35bfa031-f23a-44c3-8bfd-295689e3cc13 Jul 21 19:18:11 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:11 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD Jul 21 19:18:11 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:11 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a0e2ada3-37f3-4029-a006-16449111d5f9" returned: 0 in 0.316s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-quobyte-a0e2ada3-37f3-4029-a006-16449111d5f9" released by "delete_volume" :: held 0.923s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:11 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Created reservations ['d3ac9ffc-c0c2-4652-a918-2b107a770305', '4cdc42e9-882d-46cb-9a64-8e019397b6ee', 'f452d3c6-0334-4536-ab72-df8b73647a28', 'bb367156-30a6-4e3f-b7e6-3291914d97c1'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:11 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:11 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:11 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:11 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD Jul 21 19:18:11 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:11 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.422s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:11 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:11 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Deleted volume successfully. Jul 21 19:18:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d570922f-9887-4056-8459-a68b7be40e00 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-a0e2ada3-37f3-4029-a006-16449111d5f9-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:12 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD" returned: 1 in 1.061s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:18:12 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] 1e9b9631-6eaf-4812-aaf3-421352f222e0 was raw, converting to qcow2 {{(pid=87570) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:18:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:12 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b Jul 21 19:18:12 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "cinder-ba8d7a7e-228d-4255-905a-c266762a933f-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-ba8d7a7e-228d-4255-905a-c266762a933f-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "cinder-quobyte-ba8d7a7e-228d-4255-905a-c266762a933f" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-quobyte-ba8d7a7e-228d-4255-905a-c266762a933f" acquired by "delete_volume" :: waited 0.048s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:12 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[650fb95a-51ec-4e61-8031-10844c404b89]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ba8d7a7e-228d-4255-905a-c266762a933f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:13 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ba8d7a7e-228d-4255-905a-c266762a933f Jul 21 19:18:13 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:13 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ba8d7a7e-228d-4255-905a-c266762a933f" returned: 0 in 0.832s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ba8d7a7e-228d-4255-905a-c266762a933f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:13 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:13 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ba8d7a7e-228d-4255-905a-c266762a933f Jul 21 19:18:13 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b" returned: 0 in 1.424s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:13 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1e9b9631-6eaf-4812-aaf3-421352f222e0_l1nx1cktdevstack@QuobyteHD, size 0.00 MB, duration 1.43 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:18:13 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 19:18:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:13 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b 1G Jul 21 19:18:13 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:14 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b 1G" returned: 0 in 1.046s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:14 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Downloaded image 1e9b9631-6eaf-4812-aaf3-421352f222e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e9b9631-6eaf-4812-aaf3-421352f222e0', 'metadata': {}}])) to volume e7131f56-9382-4fa6-8263-52d6bb5b4c7b successfully. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:18:14 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Temporary image 1e9b9631-6eaf-4812-aaf3-421352f222e0 for user 8872d66d460c425b82d9d577a2625399 is deleted. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:18:14 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Marking volume e7131f56-9382-4fa6-8263-52d6bb5b4c7b as bootable. {{(pid=87570) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:18:14 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Copying metadata from image 1e9b9631-6eaf-4812-aaf3-421352f222e0 to e7131f56-9382-4fa6-8263-52d6bb5b4c7b. {{(pid=87570) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:18:14 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Creating volume glance metadata for volume e7131f56-9382-4fa6-8263-52d6bb5b4c7b backed by image 1e9b9631-6eaf-4812-aaf3-421352f222e0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1e9b9631-6eaf-4812-aaf3-421352f222e0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '40f6d6692cc7b28655ab59e3662b498f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87570) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:18:15 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ba8d7a7e-228d-4255-905a-c266762a933f" returned: 0 in 1.205s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-quobyte-ba8d7a7e-228d-4255-905a-c266762a933f" released by "delete_volume" :: held 2.169s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21e6798-6372-44e9-a503-b25920f6a760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b', 'volume_size': 1, 'image_id': '1e9b9631-6eaf-4812-aaf3-421352f222e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e9b9631-6eaf-4812-aaf3-421352f222e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '40f6d6692cc7b28655ab59e3662b498f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '85ecfe770fd24613ae4b76a777be283f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '59f98911119aa5c0dc7e05cdb8f156d905dbe93719159f052cfb0b38dab47532290b9c2946be61deb98b75bc34fd8a2c2ee2b48319e1f9b0d651641af31a5b02', 'id': '1e9b9631-6eaf-4812-aaf3-421352f222e0', 'created_at': datetime.datetime(2026, 7, 21, 17, 17, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 17, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e9b9631-6eaf-4812-aaf3-421352f222e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9c7309-88d1-4efc-bb40-2db0c67a4570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:15 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Created reservations ['851d29e8-abfc-493a-90ab-e10fc776d5b3', '531c0a22-6553-4ad9-8b29-b8e8645a52f8', '8cc42b5e-b998-423b-a5d1-5f4c9c535986', '219d0686-27a9-4359-83e5-4d9766a77369'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:15 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Volume volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b (e7131f56-9382-4fa6-8263-52d6bb5b4c7b): created successfully Jul 21 19:18:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9c7309-88d1-4efc-bb40-2db0c67a4570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:15 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Flow 'volume_create_manager' (4133179d-c9d6-418b-8b48-9bc340b1f795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:15 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-d33a76af-e917-486f-a820-32402b890b65 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Created volume successfully. Jul 21 19:18:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:15 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:15 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:15 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:15 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Acquiring lock "cinder-e7131f56-9382-4fa6-8263-52d6bb5b4c7b-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Lock "cinder-e7131f56-9382-4fa6-8263-52d6bb5b4c7b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Acquiring lock "cinder-quobyte-e7131f56-9382-4fa6-8263-52d6bb5b4c7b" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Lock "cinder-quobyte-e7131f56-9382-4fa6-8263-52d6bb5b4c7b" acquired by "delete_volume" :: waited 0.045s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:16 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e50899-5bec-421e-b535-0710560fc5dc]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:16 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.682s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:16 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:16 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Deleted volume successfully. Jul 21 19:18:16 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b Jul 21 19:18:16 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1cf42e33-1986-43ea-ada3-a18f8b1a96be tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-ba8d7a7e-228d-4255-905a-c266762a933f-delete_volume" released by "delete_volume" :: held 3.694s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "cinder-9d903388-fe54-4fc5-8f47-42093ada8721-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-9d903388-fe54-4fc5-8f47-42093ada8721-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "cinder-quobyte-9d903388-fe54-4fc5-8f47-42093ada8721" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-quobyte-9d903388-fe54-4fc5-8f47-42093ada8721" acquired by "delete_volume" :: waited 0.036s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:16 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ff25dd-e676-4473-abe8-9680728ba10d]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d903388-fe54-4fc5-8f47-42093ada8721 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:17 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d903388-fe54-4fc5-8f47-42093ada8721 Jul 21 19:18:17 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:17 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b" returned: 0 in 1.077s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:17 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b Jul 21 19:18:17 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:17 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35bfa031-f23a-44c3-8bfd-295689e3cc13" returned: 0 in 6.354s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:17 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e943dec-fd70-425a-81bc-b37f41aad308]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:17 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 Jul 21 19:18:17 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:17 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-e7131f56-9382-4fa6-8263-52d6bb5b4c7b" returned: 0 in 0.394s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:17 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d903388-fe54-4fc5-8f47-42093ada8721" returned: 0 in 0.759s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d903388-fe54-4fc5-8f47-42093ada8721 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:17 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Lock "cinder-quobyte-e7131f56-9382-4fa6-8263-52d6bb5b4c7b" released by "delete_volume" :: held 1.592s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:17 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d903388-fe54-4fc5-8f47-42093ada8721 Jul 21 19:18:17 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:17 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Created reservations ['b7ce97aa-fc66-48aa-bc05-32353bd97968', '7d43fc49-76cd-4602-8f3b-f74753e138ab', '1e88bd1a-62b3-49a8-8935-36e802a25698', 'd6c1b7a3-6ec0-4760-8108-d2e7b2f2240c'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:17 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:17 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:18 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9d903388-fe54-4fc5-8f47-42093ada8721" returned: 0 in 0.352s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-quobyte-9d903388-fe54-4fc5-8f47-42093ada8721" released by "delete_volume" :: held 1.214s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Created reservations ['bd54dd82-a338-4073-839c-9311b08e3890', 'ca9cbe3b-5bce-4841-8e43-70f2ff4bdb1a', 'ada768f8-f456-44c2-9004-5e445dc4d64b', '34d75097-7c77-4387-a3d5-bed40625db0b'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:18 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3" returned: 0 in 0.737s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Image conversion details: src /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35bfa031-f23a-44c3-8bfd-295689e3cc13 {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:18:18 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Converted 1024.00 MB image at 160.99 MB/s Jul 21 19:18:18 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35bfa031-f23a-44c3-8bfd-295689e3cc13 is being set with open permissions: ugo+rw Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35bfa031-f23a-44c3-8bfd-295689e3cc13 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:18 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35bfa031-f23a-44c3-8bfd-295689e3cc13 Jul 21 19:18:18 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:18 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:18 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:18 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.553s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:18 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Deleted volume successfully. Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2deab9e8-2b37-4a96-9669-f24fa89a75b4 tempest-VolumeAndVolumeTypeFromImageTest-1933748942 None] Lock "cinder-e7131f56-9382-4fa6-8263-52d6bb5b4c7b-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:18 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35bfa031-f23a-44c3-8bfd-295689e3cc13" returned: 0 in 0.427s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-quobyte-35bfa031-f23a-44c3-8bfd-295689e3cc13" released by "_copy_volume_from_snapshot" :: held 8.679s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-quobyte-7122e721-f550-4954-bee6-2158e47acb35-35bfa031-f23a-44c3-8bfd-295689e3cc13" released by "_create_volume_from_snapshot" :: held 8.753s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.797s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48afc4e-a550-4d29-a7ce-5a0c6be6bfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35bfa031-f23a-44c3-8bfd-295689e3cc13', 'volume_size': 1, 'snapshot_id': '7122e721-f550-4954-bee6-2158e47acb35'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4896acc4-8a0f-4405-a376-5f8e6d33101a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:18 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Volume volume-35bfa031-f23a-44c3-8bfd-295689e3cc13 (35bfa031-f23a-44c3-8bfd-295689e3cc13): created successfully Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4896acc4-8a0f-4405-a376-5f8e6d33101a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Flow 'volume_create_manager' (1dccbf45-4942-4c6b-a019-bb755f051eb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:18 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.489s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:18 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Deleted volume successfully. Jul 21 19:18:18 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-5074792f-5eca-4430-bb78-fe711eed4d31 tempest-VolumeDependencyTests-1979607568 None] Created volume successfully. Jul 21 19:18:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-bd9ce182-85d0-4f7e-aa40-ece0af52be6d tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-9d903388-fe54-4fc5-8f47-42093ada8721-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "cinder-80626a65-5e58-4eae-b51f-e18b58012be5-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-80626a65-5e58-4eae-b51f-e18b58012be5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "cinder-quobyte-80626a65-5e58-4eae-b51f-e18b58012be5" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-quobyte-80626a65-5e58-4eae-b51f-e18b58012be5" acquired by "delete_volume" :: waited 0.019s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aac4c6-ff49-49d7-b00a-dab0f96116af]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-80626a65-5e58-4eae-b51f-e18b58012be5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:19 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-80626a65-5e58-4eae-b51f-e18b58012be5 Jul 21 19:18:19 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] Acquiring lock "cinder-7122e721-f550-4954-bee6-2158e47acb35-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-7122e721-f550-4954-bee6-2158e47acb35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] Acquiring lock "cinder-quobyte-3e75f33a-0bf4-4d51-8425-d6894256bdf3" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-quobyte-3e75f33a-0bf4-4d51-8425-d6894256bdf3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] Acquiring lock "cinder-quobyte-7122e721-f550-4954-bee6-2158e47acb35" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-quobyte-7122e721-f550-4954-bee6-2158e47acb35" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] Deleting offline snapshot 7122e721-f550-4954-bee6-2158e47acb35 of volume 3e75f33a-0bf4-4d51-8425-d6894256bdf3 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] snapshot_file for this snap is: volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:18:19 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-80626a65-5e58-4eae-b51f-e18b58012be5" returned: 0 in 0.535s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-80626a65-5e58-4eae-b51f-e18b58012be5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bd2af5-aa92-44dd-8ecf-21596112448c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:19 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-80626a65-5e58-4eae-b51f-e18b58012be5 Jul 21 19:18:19 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:20 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35 Jul 21 19:18:20 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:20 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-80626a65-5e58-4eae-b51f-e18b58012be5" returned: 0 in 0.367s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-quobyte-80626a65-5e58-4eae-b51f-e18b58012be5" released by "delete_volume" :: held 0.961s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:20 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35" returned: 0 in 0.475s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:18:20 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb829e41-11ac-4abf-9fc4-457a66e37014]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:20 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Created reservations ['b4aad45a-7040-4087-b1c3-79037aa5c7de', '0577f223-8924-43da-8574-38559a5b717d', '1f52ab25-dafe-46b9-a6ec-33f77d8375ed', 'f3a306c7-9ad8-4682-ab28-b1c2ea5cbae9'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:20 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 Jul 21 19:18:20 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:20 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:20 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:20 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3" returned: 0 in 0.495s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:20 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.345s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:20 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:20 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Deleted volume successfully. Jul 21 19:18:21 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35 Jul 21 19:18:21 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-01da9aff-4f4e-4796-b10f-6f7265f5af45 tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-80626a65-5e58-4eae-b51f-e18b58012be5-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:21 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35" returned: 0 in 0.427s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:21 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35 Jul 21 19:18:21 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "cinder-54b13c0a-974f-4755-acef-4f34fbfb3022-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-54b13c0a-974f-4755-acef-4f34fbfb3022-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "cinder-quobyte-54b13c0a-974f-4755-acef-4f34fbfb3022" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-quobyte-54b13c0a-974f-4755-acef-4f34fbfb3022" acquired by "delete_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:21 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b55420-77ea-4eba-897c-c26679aee2a7]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-54b13c0a-974f-4755-acef-4f34fbfb3022 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:21 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3.7122e721-f550-4954-bee6-2158e47acb35" returned: 0 in 0.362s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-quobyte-7122e721-f550-4954-bee6-2158e47acb35" released by "_delete_snapshot" :: held 1.959s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-quobyte-3e75f33a-0bf4-4d51-8425-d6894256bdf3" released by "delete_snapshot" :: held 2.004s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:21 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-54b13c0a-974f-4755-acef-4f34fbfb3022 Jul 21 19:18:21 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:21 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] Created reservations ['4e8b2a7e-6e16-460d-870a-b7c8dc4bcfd1', '01632923-231d-48f0-b605-9d772a3ce3e3', '77628546-20a7-4550-9453-d95c9a1eca3a', '3392ceca-2b5c-4a46-af42-4775ddd01559'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:22 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] Delete snapshot completed successfully. Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-fef05e5e-64e7-4d5c-9193-085842545a95 tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-7122e721-f550-4954-bee6-2158e47acb35-delete_snapshot" released by "delete_snapshot" :: held 2.230s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:22 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-54b13c0a-974f-4755-acef-4f34fbfb3022" returned: 0 in 0.515s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-54b13c0a-974f-4755-acef-4f34fbfb3022 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:22 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-54b13c0a-974f-4755-acef-4f34fbfb3022 Jul 21 19:18:22 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:22 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-54b13c0a-974f-4755-acef-4f34fbfb3022" returned: 0 in 0.290s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-quobyte-54b13c0a-974f-4755-acef-4f34fbfb3022" released by "delete_volume" :: held 0.858s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Created reservations ['b4c754df-3461-467d-9106-7c27686c0051', 'd3e7189d-58e7-4b21-8b81-164c10d43200', 'a105bfc2-9488-4dce-ab77-725071ab158b', '203bc898-40d8-448c-aa20-e0a7a62989f0'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:22 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:22 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "cinder-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "cinder-quobyte-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-quobyte-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4" acquired by "delete_volume" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[552d8973-6e50-407f-869d-e36683f9a5f9]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:23 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.338s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:23 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:23 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Deleted volume successfully. Jul 21 19:18:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-89e92ab7-35b3-4f16-8764-2ea69d1d69ee tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-54b13c0a-974f-4755-acef-4f34fbfb3022-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:23 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4 Jul 21 19:18:23 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] Acquiring lock "cinder-3e75f33a-0bf4-4d51-8425-d6894256bdf3-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-3e75f33a-0bf4-4d51-8425-d6894256bdf3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] Acquiring lock "cinder-quobyte-3e75f33a-0bf4-4d51-8425-d6894256bdf3" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-quobyte-3e75f33a-0bf4-4d51-8425-d6894256bdf3" acquired by "delete_volume" :: waited 0.024s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:23 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[81355c27-2be6-4930-9853-926de7b8f09e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:23 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4" returned: 0 in 0.544s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:23 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 Jul 21 19:18:23 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:23 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4 Jul 21 19:18:23 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:23 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4" returned: 0 in 0.353s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-quobyte-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4" released by "delete_volume" :: held 0.968s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:23 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3" returned: 0 in 0.575s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:23 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3 Jul 21 19:18:23 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:23 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Created reservations ['d6b5c39c-2fbc-419a-a07e-9c0a5386328e', '6105716b-1ee6-465c-b77d-3b8a861ab914', '63dddedf-3ee9-47a7-a9c5-8be6e8a99c2e', 'e13ae6c9-155c-4027-9c9f-4072240bc2e7'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:24 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:24 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:24 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3e75f33a-0bf4-4d51-8425-d6894256bdf3" returned: 0 in 0.546s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-quobyte-3e75f33a-0bf4-4d51-8425-d6894256bdf3" released by "delete_volume" :: held 1.226s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (48942258-b611-4268-bcd9-94e89fd0e274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a8aeac-e4db-42b6-a9ef-dcb0b94f42e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:24 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a8aeac-e4db-42b6-a9ef-dcb0b94f42e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1114094571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a937363-0cb4-49fa-8f24-6d266d3d347c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:24Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152c574a-ebef-4498-8347-f8f71265592c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152c574a-ebef-4498-8347-f8f71265592c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e73653-9630-4c8d-8e22-da206c01adf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e73653-9630-4c8d-8e22-da206c01adf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a937363-0cb4-49fa-8f24-6d266d3d347c', 'volume_name': 'volume-1a937363-0cb4-49fa-8f24-6d266d3d347c', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5ca7ea-10ed-4b0d-ba15-0f83b496b74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5ca7ea-10ed-4b0d-ba15-0f83b496b74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0fb753a-05d8-4294-ada7-140fea632f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:24 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Volume 1a937363-0cb4-49fa-8f24-6d266d3d347c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a937363-0cb4-49fa-8f24-6d266d3d347c', 'volume_size': 1} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1114094571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a937363-0cb4-49fa-8f24-6d266d3d347c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:24Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Creating volume 1a937363-0cb4-49fa-8f24-6d266d3d347c {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:24 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.545s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:24 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c 1073741824 Jul 21 19:18:24 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:24 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Deleted volume successfully. Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-2d2af230-c269-4405-8fea-c1ebff939b9c tempest-CreateVolumesFromSourceVolumeTest-695949465 None] Lock "cinder-f4a6ca0b-1506-43d7-bba4-fd492b9ba6f4-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] Created reservations ['585cd6fd-ca82-49cb-8402-34f710329ccc', '85dfc374-9eff-415a-b76b-91c30cbc4411', '8e4504f4-769b-4c02-bfeb-5108ecd6e41b', '41c21065-60fe-4acd-b464-28ab1aeb4e73'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Flow 'volume_create_manager' (98ab1f1d-5f64-4354-910f-d8d0bf0a9002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092a5b90-434c-4127-a4f2-aaf2ff766697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092a5b90-434c-4127-a4f2-aaf2ff766697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1610384685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f861caf7b4a044ca8a877c6e40df6746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:25Z,use_quota=True,user_id='20f7e3cf5676476faac290949467535c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00623a2-db6b-4290-8aea-520e040fc5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:25 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:25 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00623a2-db6b-4290-8aea-520e040fc5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e32f3f-678c-413f-afc3-08474cb81b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e32f3f-678c-413f-afc3-08474cb81b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1', 'volume_name': 'volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ad8352-8cba-4f43-b32f-f8d6f2e737dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ad8352-8cba-4f43-b32f-f8d6f2e737dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (422357da-d1b5-4ef4-8684-047e3e513e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:25 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume 7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1', 'volume_size': 1} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:25 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c 1073741824" returned: 0 in 0.613s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:25 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.317s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:25 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c Jul 21 19:18:25 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] Deleted volume successfully. Jul 21 19:18:25 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-82a42280-b10c-47e2-8542-ea39d22b8a8d tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-3e75f33a-0bf4-4d51-8425-d6894256bdf3-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] Acquiring lock "cinder-35bfa031-f23a-44c3-8bfd-295689e3cc13-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-35bfa031-f23a-44c3-8bfd-295689e3cc13-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] Acquiring lock "cinder-quobyte-35bfa031-f23a-44c3-8bfd-295689e3cc13" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-quobyte-35bfa031-f23a-44c3-8bfd-295689e3cc13" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:25 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[74956e6e-80c6-4d8c-a888-9597ed86e5d8]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35bfa031-f23a-44c3-8bfd-295689e3cc13 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c" returned: 0 in 0.392s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.630s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1610384685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f861caf7b4a044ca8a877c6e40df6746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:25Z,use_quota=True,user_id='20f7e3cf5676476faac290949467535c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Creating volume 7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:25 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0fb753a-05d8-4294-ada7-140fea632f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a937363-0cb4-49fa-8f24-6d266d3d347c', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:25 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 1073741824 Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc9eec4-7c83-4110-ad26-8c59b5a4d3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:25 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:25 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Volume volume-1a937363-0cb4-49fa-8f24-6d266d3d347c (1a937363-0cb4-49fa-8f24-6d266d3d347c): created successfully Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc9eec4-7c83-4110-ad26-8c59b5a4d3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:25 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (48942258-b611-4268-bcd9-94e89fd0e274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:25 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-080cd8bf-7fad-42bd-9009-580a4aaf7adb tempest-ProjectMemberTests-1649818385 None] Created volume successfully. Jul 21 19:18:25 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35bfa031-f23a-44c3-8bfd-295689e3cc13 Jul 21 19:18:25 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:26 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35bfa031-f23a-44c3-8bfd-295689e3cc13" returned: 0 in 0.527s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35bfa031-f23a-44c3-8bfd-295689e3cc13 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:26 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35bfa031-f23a-44c3-8bfd-295689e3cc13 Jul 21 19:18:26 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:26 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 1073741824" returned: 0 in 0.600s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:26 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 Jul 21 19:18:26 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:26 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35bfa031-f23a-44c3-8bfd-295689e3cc13" returned: 0 in 0.329s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-quobyte-35bfa031-f23a-44c3-8bfd-295689e3cc13" released by "delete_volume" :: held 0.919s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] Created reservations ['13f06312-e48e-46c3-b779-13aecfe6cb9c', '7e96081a-e1f3-417c-822a-0a6aee014478', '2748ea58-c3aa-43a2-8fd1-2a75c5b58454', 'aae4693f-27ba-4bee-af7b-944a78e14342'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:26 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1" returned: 0 in 0.308s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (422357da-d1b5-4ef4-8684-047e3e513e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3fc92a-b51a-443e-8095-766659e354e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:26 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 (7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1): created successfully Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3fc92a-b51a-443e-8095-766659e354e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Flow 'volume_create_manager' (98ab1f1d-5f64-4354-910f-d8d0bf0a9002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:26 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c0f42383-b0b1-4ac3-82c2-a875393b99fa tempest-CreateVolumesFromSnapshotTest-128978447 None] Created volume successfully. Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:26 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:26 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:27 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.423s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:27 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] Creating offline snapshot 1959002f-f092-40d2-b821-6d167f4a46a8 of volume 1a937363-0cb4-49fa-8f24-6d266d3d347c {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:18:27 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] Deleted volume successfully. Jul 21 19:18:27 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb115677-bd9b-484d-91ad-0cdc205aee01]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0cfdd634-4e4f-4144-a985-7204a4ae4019 tempest-VolumeDependencyTests-1979607568 None] Lock "cinder-35bfa031-f23a-44c3-8bfd-295689e3cc13-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:27 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c Jul 21 19:18:27 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:27 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c" returned: 0 in 0.466s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:27 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8 1G Jul 21 19:18:27 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:28 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8 1G" returned: 0 in 0.545s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a937363-0cb4-49fa-8f24-6d266d3d347c -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:28 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a937363-0cb4-49fa-8f24-6d266d3d347c -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8 Jul 21 19:18:28 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:28 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a937363-0cb4-49fa-8f24-6d266d3d347c -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8" returned: 0 in 0.362s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:28 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8 is being set with open permissions: ugo+rw Jul 21 19:18:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:28 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8 Jul 21 19:18:28 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:28 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8" returned: 0 in 0.324s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:29 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.info Jul 21 19:18:29 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:29 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.info" returned: 0 in 0.316s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:29 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.info is being set with open permissions: ugo+rw Jul 21 19:18:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:29 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.info Jul 21 19:18:29 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:29 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.info" returned: 0 in 0.346s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.367s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:29 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] Creating offline snapshot 116666e8-e06a-4520-b68b-a692a9d427ed of volume 7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:18:29 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-007c2612-76b7-4013-ab4a-a2d1770554e3 tempest-ProjectMemberTests-1649818385 None] Create snapshot completed successfully Jul 21 19:18:29 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bb61f8-9a7e-4493-a76b-31b94a330426]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:29 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 Jul 21 19:18:29 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:30 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1" returned: 0 in 0.429s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:30 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed 1G Jul 21 19:18:30 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-1959002f-f092-40d2-b821-6d167f4a46a8-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-1959002f-f092-40d2-b821-6d167f4a46a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-1a937363-0cb4-49fa-8f24-6d266d3d347c" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-1a937363-0cb4-49fa-8f24-6d266d3d347c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-1959002f-f092-40d2-b821-6d167f4a46a8" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-1959002f-f092-40d2-b821-6d167f4a46a8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] Deleting offline snapshot 1959002f-f092-40d2-b821-6d167f4a46a8 of volume 1a937363-0cb4-49fa-8f24-6d266d3d347c {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:18:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] snapshot_file for this snap is: volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:18:30 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf9afe0-817f-491d-93e3-1c84e0a5000f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:30 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8 Jul 21 19:18:30 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:30 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed 1G" returned: 0 in 0.582s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:30 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed Jul 21 19:18:30 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:31 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8" returned: 0 in 0.493s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a937363-0cb4-49fa-8f24-6d266d3d347c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:18:31 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad57fc85-d6b6-4e94-b0f4-a75bbad7e12b]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:31 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed" returned: 0 in 0.421s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:31 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed is being set with open permissions: ugo+rw Jul 21 19:18:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:31 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c Jul 21 19:18:31 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:31 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed Jul 21 19:18:31 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:31 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed" returned: 0 in 0.349s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:31 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c" returned: 0 in 0.534s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:31 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8 Jul 21 19:18:31 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:31 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.info Jul 21 19:18:31 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Flow 'volume_create_manager' (e86308fa-9e38-455d-b653-5781c7a5698c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:32 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5e5db3-0571-411a-993a-393135f4cf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.info" returned: 0 in 0.388s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:32 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.info is being set with open permissions: ugo+rw Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:32 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.info Jul 21 19:18:32 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5e5db3-0571-411a-993a-393135f4cf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6bd9f1-67d0-48f2-af28-229e0e64e33d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a37e9603a54284b2b95674d90a64c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:32Z,use_quota=True,user_id='12b4a7264bb8477bbb83cb45fbe45140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eccf4043-45b0-4120-8ee5-c676dd47bd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eccf4043-45b0-4120-8ee5-c676dd47bd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ace99d8-238c-4b73-ad61-9b49204ec2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG cinder.image.glance [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Creating Keystone auth plugin from conf {{(pid=87570) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:18:32 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8" returned: 0 in 0.663s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:32 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8 Jul 21 19:18:32 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:32 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.info" returned: 0 in 0.490s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.871s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:32 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-38e22078-349e-4d3c-8e98-164a1260056f tempest-CreateVolumesFromSnapshotTest-128978447 None] Create snapshot completed successfully Jul 21 19:18:32 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c.1959002f-f092-40d2-b821-6d167f4a46a8" returned: 0 in 0.454s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-1959002f-f092-40d2-b821-6d167f4a46a8" released by "_delete_snapshot" :: held 2.295s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-1a937363-0cb4-49fa-8f24-6d266d3d347c" released by "delete_snapshot" :: held 2.326s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] Created reservations ['93236328-2e76-4c4b-a002-60c9a9d4cee0', '96386401-c82d-4f8e-af8a-918ccb025bb5', 'bbbe2b41-258a-4e5a-aee5-f90a76f888c9', '6375375b-870d-47ed-8523-4762bc987d05'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ace99d8-238c-4b73-ad61-9b49204ec2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f6bd9f1-67d0-48f2-af28-229e0e64e33d', 'volume_name': 'volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d', 'volume_size': 1, 'image_id': '2f225f70-3bb8-42b4-ae92-6d7ed6019e33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f225f70-3bb8-42b4-ae92-6d7ed6019e33', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cdd07a4f95fa24f96b85174c578ff494', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '08a37e9603a54284b2b95674d90a64c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79a932361aef07029a3a1570a250ff43ca2589c001e8f0b88fbd25475cac4d5fee7ea71c7f41f0ff58256b3fd9348382fe9b9d237dc950904e9532da712ca953', 'id': '2f225f70-3bb8-42b4-ae92-6d7ed6019e33', 'created_at': datetime.datetime(2026, 7, 21, 17, 18, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 18, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f225f70-3bb8-42b4-ae92-6d7ed6019e33/file', 'properties': {}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca679ba-dd0a-440b-8192-6720dd400ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca679ba-dd0a-440b-8192-6720dd400ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:32 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3645a6-b037-472c-b547-51eb941485d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:33 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Volume 7f6bd9f1-67d0-48f2-af28-229e0e64e33d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d', 'volume_size': 1, 'image_id': '2f225f70-3bb8-42b4-ae92-6d7ed6019e33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f225f70-3bb8-42b4-ae92-6d7ed6019e33', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cdd07a4f95fa24f96b85174c578ff494', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '08a37e9603a54284b2b95674d90a64c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79a932361aef07029a3a1570a250ff43ca2589c001e8f0b88fbd25475cac4d5fee7ea71c7f41f0ff58256b3fd9348382fe9b9d237dc950904e9532da712ca953', 'id': '2f225f70-3bb8-42b4-ae92-6d7ed6019e33', 'created_at': datetime.datetime(2026, 7, 21, 17, 18, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 18, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f225f70-3bb8-42b4-ae92-6d7ed6019e33/file', 'properties': {}}, 'image_service': } Jul 21 19:18:33 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Trying to clone 7f6bd9f1-67d0-48f2-af28-229e0e64e33d from image 2f225f70-3bb8-42b4-ae92-6d7ed6019e33 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2f225f70-3bb8-42b4-ae92-6d7ed6019e33', 'metadata': {}}]). {{(pid=87570) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:18:33 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] Delete snapshot completed successfully. Jul 21 19:18:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1a4847c9-85c7-40d4-9d65-e19a6a2607e5 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-1959002f-f092-40d2-b821-6d167f4a46a8-delete_snapshot" released by "delete_snapshot" :: held 2.600s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:33 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:18:33 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Image download 0.00 MB at 0.00 MB/s Jul 21 19:18:33 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28d24da-f5b9-4b16-bd52-edd34fbd0c2b]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:33 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD Jul 21 19:18:33 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:33 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:33 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD Jul 21 19:18:33 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-1a937363-0cb4-49fa-8f24-6d266d3d347c-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-1a937363-0cb4-49fa-8f24-6d266d3d347c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-1a937363-0cb4-49fa-8f24-6d266d3d347c" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:33 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-1a937363-0cb4-49fa-8f24-6d266d3d347c" acquired by "delete_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:33 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a417cedf-5716-4831-bc49-c59f7b6eed29]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:34 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD" returned: 1 in 0.454s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Temporary image 2f225f70-3bb8-42b4-ae92-6d7ed6019e33 is fetched for user 12b4a7264bb8477bbb83cb45fbe45140. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea09696-8a0c-4c2f-9c62-a5c87976e5f1]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:34 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c Jul 21 19:18:34 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:34 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD Jul 21 19:18:34 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:34 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c" returned: 0 in 0.523s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:34 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:34 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c Jul 21 19:18:34 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Flow 'volume_create_manager' (88108aeb-0488-4f7f-b490-1b92d34dbad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0558c85a-7e17-4e1f-b532-967bb394766b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0558c85a-7e17-4e1f-b532-967bb394766b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1098919429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c65a4355-80a0-4ecf-8742-00ae171136ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f861caf7b4a044ca8a877c6e40df6746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:35Z,use_quota=True,user_id='20f7e3cf5676476faac290949467535c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d601b4d0-6b36-4033-ba4a-e73b89e42d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d601b4d0-6b36-4033-ba4a-e73b89e42d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8999912c-d6e9-4f7b-9c27-959671716d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8999912c-d6e9-4f7b-9c27-959671716d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c65a4355-80a0-4ecf-8742-00ae171136ca', 'volume_name': 'volume-c65a4355-80a0-4ecf-8742-00ae171136ca', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13b7f3f-684c-42a8-ac8a-72fca0eb47ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13b7f3f-684c-42a8-ac8a-72fca0eb47ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b2af49d-5588-4624-968e-b26f5a2149da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:34 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume c65a4355-80a0-4ecf-8742-00ae171136ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c65a4355-80a0-4ecf-8742-00ae171136ca', 'volume_size': 1} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:34 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1098919429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c65a4355-80a0-4ecf-8742-00ae171136ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f861caf7b4a044ca8a877c6e40df6746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:35Z,use_quota=True,user_id='20f7e3cf5676476faac290949467535c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:34 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Creating volume c65a4355-80a0-4ecf-8742-00ae171136ca {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:34 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c65a4355-80a0-4ecf-8742-00ae171136ca 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:34 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c65a4355-80a0-4ecf-8742-00ae171136ca 1073741824 Jul 21 19:18:34 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:35 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1a937363-0cb4-49fa-8f24-6d266d3d347c" returned: 0 in 0.733s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-1a937363-0cb4-49fa-8f24-6d266d3d347c" released by "delete_volume" :: held 1.369s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Flow 'volume_create_manager' (38ef77ce-993d-4837-9e75-4bebf61ce52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e79537-c655-489e-83b1-0f5718ebf828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e79537-c655-489e-83b1-0f5718ebf828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-934086059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909ae090-1baa-45ac-9f32-487a124117ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f861caf7b4a044ca8a877c6e40df6746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:35Z,use_quota=True,user_id='20f7e3cf5676476faac290949467535c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387a9b18-be26-4018-b434-b53f3c46cbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:35 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387a9b18-be26-4018-b434-b53f3c46cbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9db8ce0-68e0-41ee-b677-416d29f645a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9db8ce0-68e0-41ee-b677-416d29f645a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '909ae090-1baa-45ac-9f32-487a124117ac', 'volume_name': 'volume-909ae090-1baa-45ac-9f32-487a124117ac', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa6939e5-422e-4b29-9d58-74b0ede9a1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa6939e5-422e-4b29-9d58-74b0ede9a1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a215ad-d9bc-4a84-8559-961698959250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:35 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume 909ae090-1baa-45ac-9f32-487a124117ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-909ae090-1baa-45ac-9f32-487a124117ac', 'volume_size': 1} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD" returned: 1 in 0.881s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:35 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c65a4355-80a0-4ecf-8742-00ae171136ca 1073741824" returned: 0 in 0.724s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] Created reservations ['b764a92d-adc9-4996-a250-f70427b6a6aa', '9a04808e-e227-4df9-b94d-843bb35966c0', 'c60cabed-c4cd-4eb7-8191-73a355b5142b', 'ad8b33a2-fba5-4aa8-a50b-7759603f7c7d'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c65a4355-80a0-4ecf-8742-00ae171136ca {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:35 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c65a4355-80a0-4ecf-8742-00ae171136ca Jul 21 19:18:35 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:35 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:35 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:35 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c65a4355-80a0-4ecf-8742-00ae171136ca" returned: 0 in 0.464s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.588s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-934086059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909ae090-1baa-45ac-9f32-487a124117ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f861caf7b4a044ca8a877c6e40df6746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:35Z,use_quota=True,user_id='20f7e3cf5676476faac290949467535c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Creating volume 909ae090-1baa-45ac-9f32-487a124117ac {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:36 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-909ae090-1baa-45ac-9f32-487a124117ac 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:36 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:36 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-909ae090-1baa-45ac-9f32-487a124117ac 1073741824 Jul 21 19:18:36 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Flow 'volume_create_manager' (36b2b739-018b-43c3-ba9a-ff46f12a4011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e097de-dc8e-4cfd-8e55-4aa60294c9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.448s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b2af49d-5588-4624-968e-b26f5a2149da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c65a4355-80a0-4ecf-8742-00ae171136ca', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1080a608-8d36-4cb5-9464-ae089eddb6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:36 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] Deleted volume successfully. Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e097de-dc8e-4cfd-8e55-4aa60294c9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-29627957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762c290c-6d57-4536-8efa-d1c1b96280e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f861caf7b4a044ca8a877c6e40df6746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:36Z,use_quota=True,user_id='20f7e3cf5676476faac290949467535c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e32119-95d1-4b6e-bbe8-514be6512370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e32119-95d1-4b6e-bbe8-514be6512370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2c7af1-f9fb-4828-9748-2679d69e0793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2c7af1-f9fb-4828-9748-2679d69e0793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '762c290c-6d57-4536-8efa-d1c1b96280e1', 'volume_name': 'volume-762c290c-6d57-4536-8efa-d1c1b96280e1', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05641f6a-aa1b-4ffb-abc8-9e0399a70c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05641f6a-aa1b-4ffb-abc8-9e0399a70c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0640b1-d2e6-488f-8a6b-9f78b4c491d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:36 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume 762c290c-6d57-4536-8efa-d1c1b96280e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-762c290c-6d57-4536-8efa-d1c1b96280e1', 'volume_size': 1} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:36 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume volume-c65a4355-80a0-4ecf-8742-00ae171136ca (c65a4355-80a0-4ecf-8742-00ae171136ca): created successfully Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1080a608-8d36-4cb5-9464-ae089eddb6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Flow 'volume_create_manager' (88108aeb-0488-4f7f-b490-1b92d34dbad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:36 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-6ecf854b-9408-4860-a055-e8a80262895c tempest-CreateVolumesFromSnapshotTest-128978447 None] Created volume successfully. Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-86895f45-1420-4cd9-accb-01f9909d58c6 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-1a937363-0cb4-49fa-8f24-6d266d3d347c-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Flow 'volume_create_manager' (69d61620-a1da-42a1-af3c-71427b11c5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6751ba-09e7-4182-b206-6c3eb18babc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6751ba-09e7-4182-b206-6c3eb18babc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1913468380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a6b6bf-9d04-4579-8ca4-89966b4f9413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f861caf7b4a044ca8a877c6e40df6746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:37Z,use_quota=True,user_id='20f7e3cf5676476faac290949467535c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2ecc71-00a0-43dd-8f40-c78b78352a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2ecc71-00a0-43dd-8f40-c78b78352a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4c1d03-0a70-42b4-a139-73fd270d21ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4c1d03-0a70-42b4-a139-73fd270d21ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79a6b6bf-9d04-4579-8ca4-89966b4f9413', 'volume_name': 'volume-79a6b6bf-9d04-4579-8ca4-89966b4f9413', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:36 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b46c262-4cc9-4635-b99b-6c6d4674a9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b46c262-4cc9-4635-b99b-6c6d4674a9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a5418e-8ac2-4ca9-baf4-04d90e060cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:36 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume 79a6b6bf-9d04-4579-8ca4-89966b4f9413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79a6b6bf-9d04-4579-8ca4-89966b4f9413', 'volume_size': 1} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-909ae090-1baa-45ac-9f32-487a124117ac 1073741824" returned: 0 in 0.833s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-909ae090-1baa-45ac-9f32-487a124117ac {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:36 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-909ae090-1baa-45ac-9f32-487a124117ac Jul 21 19:18:36 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (01ffeaef-430d-416a-bb8f-2004ccf0c6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00bc84f-b410-46d6-a95f-8c8fd8f80842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00bc84f-b410-46d6-a95f-8c8fd8f80842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509791432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a30df1-8a40-4cdf-bbbc-019f2e9a1a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:37Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c436f3-82e5-4e91-ad10-887268ec6eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c436f3-82e5-4e91-ad10-887268ec6eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f502c192-e1a5-458f-a40a-efe451ea9853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f502c192-e1a5-458f-a40a-efe451ea9853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a30df1-8a40-4cdf-bbbc-019f2e9a1a21', 'volume_name': 'volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9df907-c538-4ac4-bc1a-83e7a4f93cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9df907-c538-4ac4-bc1a-83e7a4f93cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7289ea5-594e-4ce7-9b4b-3f9a6787518a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:37 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Volume 81a30df1-8a40-4cdf-bbbc-019f2e9a1a21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21', 'volume_size': 1} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:37 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Flow 'volume_create_manager' (97e2f53f-f86d-4829-b21d-0a4ce4c43a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a541307-61f6-4d48-85c2-d89148775bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-909ae090-1baa-45ac-9f32-487a124117ac" returned: 0 in 0.452s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.936s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6bd9f1-67d0-48f2-af28-229e0e64e33d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a37e9603a54284b2b95674d90a64c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:32Z,use_quota=True,user_id='12b4a7264bb8477bbb83cb45fbe45140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Creating volume 7f6bd9f1-67d0-48f2-af28-229e0e64e33d {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:37 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a541307-61f6-4d48-85c2-d89148775bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1225858055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30180767-aaa5-4415-a5cc-7aa0ff0a3757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f861caf7b4a044ca8a877c6e40df6746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:37Z,use_quota=True,user_id='20f7e3cf5676476faac290949467535c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:37 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d 1073741824 Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ca1b7d-cf15-4608-8a1d-a3490d88d261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:37 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ca1b7d-cf15-4608-8a1d-a3490d88d261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0297953f-95b9-413a-bc10-28f40263f0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0297953f-95b9-413a-bc10-28f40263f0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30180767-aaa5-4415-a5cc-7aa0ff0a3757', 'volume_name': 'volume-30180767-aaa5-4415-a5cc-7aa0ff0a3757', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95839e3e-d9c2-42b6-8410-c538c0a5bb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95839e3e-d9c2-42b6-8410-c538c0a5bb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6924fd80-877a-4bdf-9a89-5fe91033e89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:37 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume 30180767-aaa5-4415-a5cc-7aa0ff0a3757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30180767-aaa5-4415-a5cc-7aa0ff0a3757', 'volume_size': 1} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a215ad-d9bc-4a84-8559-961698959250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-909ae090-1baa-45ac-9f32-487a124117ac', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90278717-ee9a-4eaa-b363-2712e0a45c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:37 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume volume-909ae090-1baa-45ac-9f32-487a124117ac (909ae090-1baa-45ac-9f32-487a124117ac): created successfully Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90278717-ee9a-4eaa-b363-2712e0a45c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Flow 'volume_create_manager' (38ef77ce-993d-4837-9e75-4bebf61ce52a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:37 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4b992447-62e8-4d97-b2bd-cac2a4800c35 tempest-CreateVolumesFromSnapshotTest-128978447 None] Created volume successfully. Jul 21 19:18:37 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d 1073741824" returned: 0 in 0.531s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:37 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d Jul 21 19:18:37 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:38 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d" returned: 0 in 0.289s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.033s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-29627957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762c290c-6d57-4536-8efa-d1c1b96280e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f861caf7b4a044ca8a877c6e40df6746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:36Z,use_quota=True,user_id='20f7e3cf5676476faac290949467535c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Creating volume 762c290c-6d57-4536-8efa-d1c1b96280e1 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:38 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-762c290c-6d57-4536-8efa-d1c1b96280e1 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:38 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-762c290c-6d57-4536-8efa-d1c1b96280e1 1073741824 Jul 21 19:18:38 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Attempting download of 2f225f70-3bb8-42b4-ae92-6d7ed6019e33 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f225f70-3bb8-42b4-ae92-6d7ed6019e33', 'metadata': {}}])) to volume 7f6bd9f1-67d0-48f2-af28-229e0e64e33d. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[afffb564-0a68-4efd-a5f1-15dc99bf75df]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_o2a0p7h7 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:38 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_o2a0p7h7 Jul 21 19:18:38 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:38 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_o2a0p7h7" returned: 0 in 0.417s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_o2a0p7h7 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:38 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-762c290c-6d57-4536-8efa-d1c1b96280e1 1073741824" returned: 0 in 0.575s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-762c290c-6d57-4536-8efa-d1c1b96280e1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:38 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-762c290c-6d57-4536-8efa-d1c1b96280e1 Jul 21 19:18:38 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:38 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_o2a0p7h7 Jul 21 19:18:38 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:39 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_o2a0p7h7" returned: 1 in 0.444s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_o2a0p7h7' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2476bcb-410b-4385-8065-f16b16518b21]: (4, 'raw') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:39 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-762c290c-6d57-4536-8efa-d1c1b96280e1" returned: 0 in 0.422s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.454s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1913468380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a6b6bf-9d04-4579-8ca4-89966b4f9413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f861caf7b4a044ca8a877c6e40df6746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:37Z,use_quota=True,user_id='20f7e3cf5676476faac290949467535c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Creating volume 79a6b6bf-9d04-4579-8ca4-89966b4f9413 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:39 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-79a6b6bf-9d04-4579-8ca4-89966b4f9413 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:39 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-79a6b6bf-9d04-4579-8ca4-89966b4f9413 1073741824 Jul 21 19:18:39 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0640b1-d2e6-488f-8a6b-9f78b4c491d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-762c290c-6d57-4536-8efa-d1c1b96280e1', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f25f1f1-0e12-4eb1-9e83-8cc0ddb50387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:39 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume volume-762c290c-6d57-4536-8efa-d1c1b96280e1 (762c290c-6d57-4536-8efa-d1c1b96280e1): created successfully Jul 21 19:18:39 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f25f1f1-0e12-4eb1-9e83-8cc0ddb50387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:39 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Flow 'volume_create_manager' (36b2b739-018b-43c3-ba9a-ff46f12a4011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:39 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-ac1d5bf6-2b6b-4532-a652-39e464468190 tempest-CreateVolumesFromSnapshotTest-128978447 None] Created volume successfully. Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Flow 'volume_create_manager' (83831042-4579-4237-8813-fa3da1c4a2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da5df47-146c-4b58-8ec1-a39413a371c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da5df47-146c-4b58-8ec1-a39413a371c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1365517826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4b506a-ee81-4d45-ab7e-bb690ab70847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4246671f17ed4b9c8c1249dc31915a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:39Z,use_quota=True,user_id='ee479a3d30e64e2ba900ecb9dba13fa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d48458-65d0-4a45-a79c-f992d4b262e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d48458-65d0-4a45-a79c-f992d4b262e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d04913-08f6-48b2-81ac-70d3033075a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d04913-08f6-48b2-81ac-70d3033075a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab4b506a-ee81-4d45-ab7e-bb690ab70847', 'volume_name': 'volume-ab4b506a-ee81-4d45-ab7e-bb690ab70847', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa73ab12-f46f-49cc-ac7b-12398dc43955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa73ab12-f46f-49cc-ac7b-12398dc43955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b976ebf2-285e-4427-a03e-27cb0cd1106e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:39 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Volume ab4b506a-ee81-4d45-ab7e-bb690ab70847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab4b506a-ee81-4d45-ab7e-bb690ab70847', 'volume_size': 1} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:39 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:39 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD Jul 21 19:18:39 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:39 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-79a6b6bf-9d04-4579-8ca4-89966b4f9413 1073741824" returned: 0 in 0.547s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-79a6b6bf-9d04-4579-8ca4-89966b4f9413 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:39 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-79a6b6bf-9d04-4579-8ca4-89966b4f9413 Jul 21 19:18:39 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:40 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] 2f225f70-3bb8-42b4-ae92-6d7ed6019e33 was raw, converting to qcow2 {{(pid=87570) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:40 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d Jul 21 19:18:40 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:40 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-79a6b6bf-9d04-4579-8ca4-89966b4f9413" returned: 0 in 0.292s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.959s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509791432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a30df1-8a40-4cdf-bbbc-019f2e9a1a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:37Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Creating volume 81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:40 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a5418e-8ac2-4ca9-baf4-04d90e060cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79a6b6bf-9d04-4579-8ca4-89966b4f9413', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:40 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 1073741824 Jul 21 19:18:40 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f9b6fb-a79a-446f-85a5-de6bc1fedc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:40 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume volume-79a6b6bf-9d04-4579-8ca4-89966b4f9413 (79a6b6bf-9d04-4579-8ca4-89966b4f9413): created successfully Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f9b6fb-a79a-446f-85a5-de6bc1fedc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Flow 'volume_create_manager' (69d61620-a1da-42a1-af3c-71427b11c5c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:40 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-57ef55d7-1fb9-4479-ad28-515d58eee24a tempest-CreateVolumesFromSnapshotTest-128978447 None] Created volume successfully. Jul 21 19:18:40 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d" returned: 0 in 0.566s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2f225f70-3bb8-42b4-ae92-6d7ed6019e33_7015v5mhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:18:40 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:40 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d 1G Jul 21 19:18:40 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:40 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 1073741824" returned: 0 in 0.556s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:40 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 Jul 21 19:18:40 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:41 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d 1G" returned: 0 in 0.371s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Downloaded image 2f225f70-3bb8-42b4-ae92-6d7ed6019e33 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f225f70-3bb8-42b4-ae92-6d7ed6019e33', 'metadata': {}}])) to volume 7f6bd9f1-67d0-48f2-af28-229e0e64e33d successfully. {{(pid=87570) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Temporary image 2f225f70-3bb8-42b4-ae92-6d7ed6019e33 for user 12b4a7264bb8477bbb83cb45fbe45140 is deleted. {{(pid=87570) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.volume_utils [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Marking volume 7f6bd9f1-67d0-48f2-af28-229e0e64e33d as bootable. {{(pid=87570) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Copying metadata from image 2f225f70-3bb8-42b4-ae92-6d7ed6019e33 to 7f6bd9f1-67d0-48f2-af28-229e0e64e33d. {{(pid=87570) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Creating volume glance metadata for volume 7f6bd9f1-67d0-48f2-af28-229e0e64e33d backed by image 2f225f70-3bb8-42b4-ae92-6d7ed6019e33 with: {'image_id': '2f225f70-3bb8-42b4-ae92-6d7ed6019e33', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cdd07a4f95fa24f96b85174c578ff494', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87570) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:18:41 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21" returned: 0 in 0.295s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.686s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1225858055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30180767-aaa5-4415-a5cc-7aa0ff0a3757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f861caf7b4a044ca8a877c6e40df6746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:37Z,use_quota=True,user_id='20f7e3cf5676476faac290949467535c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Creating volume 30180767-aaa5-4415-a5cc-7aa0ff0a3757 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:41 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-30180767-aaa5-4415-a5cc-7aa0ff0a3757 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:41 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-30180767-aaa5-4415-a5cc-7aa0ff0a3757 1073741824 Jul 21 19:18:41 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7289ea5-594e-4ce7-9b4b-3f9a6787518a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcda0004-700e-4957-968a-0a596bfa09b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3645a6-b037-472c-b547-51eb941485d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d', 'volume_size': 1, 'image_id': '2f225f70-3bb8-42b4-ae92-6d7ed6019e33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f225f70-3bb8-42b4-ae92-6d7ed6019e33', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cdd07a4f95fa24f96b85174c578ff494', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '08a37e9603a54284b2b95674d90a64c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79a932361aef07029a3a1570a250ff43ca2589c001e8f0b88fbd25475cac4d5fee7ea71c7f41f0ff58256b3fd9348382fe9b9d237dc950904e9532da712ca953', 'id': '2f225f70-3bb8-42b4-ae92-6d7ed6019e33', 'created_at': datetime.datetime(2026, 7, 21, 17, 18, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 18, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f225f70-3bb8-42b4-ae92-6d7ed6019e33/file', 'properties': {}}, 'image_service': }' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335c4b89-6e97-443c-8c2f-37ad2d1e72d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:41 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Volume volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 (81a30df1-8a40-4cdf-bbbc-019f2e9a1a21): created successfully Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcda0004-700e-4957-968a-0a596bfa09b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (01ffeaef-430d-416a-bb8f-2004ccf0c6f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:41 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Volume volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d (7f6bd9f1-67d0-48f2-af28-229e0e64e33d): created successfully Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335c4b89-6e97-443c-8c2f-37ad2d1e72d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Flow 'volume_create_manager' (e86308fa-9e38-455d-b653-5781c7a5698c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:41 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-93004c77-8626-4d42-b642-bc0cfbdf71fc tempest-ProjectMemberTests-1649818385 None] Created volume successfully. Jul 21 19:18:41 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-7a555776-fe41-4eb7-9005-7d1ac1ce2775 tempest-VolumeImageDependencyTests-1977792354 None] Created volume successfully. Jul 21 19:18:41 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-30180767-aaa5-4415-a5cc-7aa0ff0a3757 1073741824" returned: 0 in 0.499s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-30180767-aaa5-4415-a5cc-7aa0ff0a3757 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:41 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-30180767-aaa5-4415-a5cc-7aa0ff0a3757 Jul 21 19:18:41 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:41 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-30180767-aaa5-4415-a5cc-7aa0ff0a3757" returned: 0 in 0.281s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.407s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1365517826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4b506a-ee81-4d45-ab7e-bb690ab70847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4246671f17ed4b9c8c1249dc31915a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:39Z,use_quota=True,user_id='ee479a3d30e64e2ba900ecb9dba13fa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Creating volume ab4b506a-ee81-4d45-ab7e-bb690ab70847 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:41 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab4b506a-ee81-4d45-ab7e-bb690ab70847 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] Acquiring lock "cinder-7f6bd9f1-67d0-48f2-af28-229e0e64e33d-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:42 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab4b506a-ee81-4d45-ab7e-bb690ab70847 1073741824 Jul 21 19:18:42 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6924fd80-877a-4bdf-9a89-5fe91033e89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30180767-aaa5-4415-a5cc-7aa0ff0a3757', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82543b94-7416-4d17-83a9-705a094971d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:42 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Volume volume-30180767-aaa5-4415-a5cc-7aa0ff0a3757 (30180767-aaa5-4415-a5cc-7aa0ff0a3757): created successfully Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82543b94-7416-4d17-83a9-705a094971d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Flow 'volume_create_manager' (97e2f53f-f86d-4829-b21d-0a4ce4c43a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] Lock "cinder-7f6bd9f1-67d0-48f2-af28-229e0e64e33d-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:42 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-ee4ae53a-0c23-4cd6-8280-a06ae29b916d tempest-CreateVolumesFromSnapshotTest-128978447 None] Created volume successfully. Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] Acquiring lock "cinder-quobyte-7f6bd9f1-67d0-48f2-af28-229e0e64e33d" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] Lock "cinder-quobyte-7f6bd9f1-67d0-48f2-af28-229e0e64e33d" acquired by "delete_volume" :: waited 0.014s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15784ec-af2b-4c9d-b0fd-4ef2f8352cde]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:42 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d Jul 21 19:18:42 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:42 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab4b506a-ee81-4d45-ab7e-bb690ab70847 1073741824" returned: 0 in 0.579s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab4b506a-ee81-4d45-ab7e-bb690ab70847 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:42 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d" returned: 0 in 0.458s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:42 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab4b506a-ee81-4d45-ab7e-bb690ab70847 Jul 21 19:18:42 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:42 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d Jul 21 19:18:42 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:42 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab4b506a-ee81-4d45-ab7e-bb690ab70847" returned: 0 in 0.271s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.323s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "cinder-30180767-aaa5-4415-a5cc-7aa0ff0a3757-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:42 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b976ebf2-285e-4427-a03e-27cb0cd1106e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab4b506a-ee81-4d45-ab7e-bb690ab70847', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ffdaa9-d4d0-450d-800b-a611863ba96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] Creating offline snapshot 542316b8-22e1-49e6-b7f4-11a99c128c38 of volume 81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-30180767-aaa5-4415-a5cc-7aa0ff0a3757-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7f6bd9f1-67d0-48f2-af28-229e0e64e33d" returned: 0 in 0.338s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[68701c94-99ba-456f-b1d6-421c1eea2dd0]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:42 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Volume volume-ab4b506a-ee81-4d45-ab7e-bb690ab70847 (ab4b506a-ee81-4d45-ab7e-bb690ab70847): created successfully Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ffdaa9-d4d0-450d-800b-a611863ba96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:42 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Flow 'volume_create_manager' (83831042-4579-4237-8813-fa3da1c4a2a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] Lock "cinder-quobyte-7f6bd9f1-67d0-48f2-af28-229e0e64e33d" released by "delete_volume" :: held 0.881s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:43 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f04dc5ac-4ac2-4464-b90c-f794c01b8b9a tempest-ProjectReaderTests-68191742 None] Created volume successfully. Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "cinder-quobyte-30180767-aaa5-4415-a5cc-7aa0ff0a3757" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-quobyte-30180767-aaa5-4415-a5cc-7aa0ff0a3757" acquired by "delete_volume" :: waited 0.025s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:43 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 Jul 21 19:18:43 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[05011d83-b765-401c-bd97-e6d4e5ae77d0]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-30180767-aaa5-4415-a5cc-7aa0ff0a3757 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] Created reservations ['ee5f9094-4c19-4faa-b398-96d4827245ba', '62522a5f-e59d-4462-96f5-f504bfafd641', 'a9e1aaa6-9216-4272-8a47-8f5714cc65fd', '90bb2b69-25ec-4f0e-9ebc-0b1c7314557c'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:43 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-30180767-aaa5-4415-a5cc-7aa0ff0a3757 Jul 21 19:18:43 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:43 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:43 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:43 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21" returned: 0 in 0.471s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:43 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38 1G Jul 21 19:18:43 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:43 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.315s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:43 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-30180767-aaa5-4415-a5cc-7aa0ff0a3757" returned: 0 in 0.427s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-30180767-aaa5-4415-a5cc-7aa0ff0a3757 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:43 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] Deleted volume successfully. Jul 21 19:18:43 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-30180767-aaa5-4415-a5cc-7aa0ff0a3757 Jul 21 19:18:43 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-64633cc9-11e3-483c-b8c2-233db31d3170 tempest-VolumeImageDependencyTests-1977792354 None] Lock "cinder-7f6bd9f1-67d0-48f2-af28-229e0e64e33d-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:43 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-30180767-aaa5-4415-a5cc-7aa0ff0a3757" returned: 0 in 0.307s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-quobyte-30180767-aaa5-4415-a5cc-7aa0ff0a3757" released by "delete_volume" :: held 0.808s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] Acquiring lock "cinder-ab4b506a-ee81-4d45-ab7e-bb690ab70847-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] Lock "cinder-ab4b506a-ee81-4d45-ab7e-bb690ab70847-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:43 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] Acquiring lock "cinder-quobyte-ab4b506a-ee81-4d45-ab7e-bb690ab70847" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38 1G" returned: 0 in 0.551s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] Created reservations ['46d43034-8abc-468d-a416-f0f1ca3334da', '8d0154e6-1722-42d2-9053-230474ddd802', 'ba841e5f-8d6d-4480-b52c-463565697567', '69034978-bffd-4938-8ee5-ecc15a7968aa'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] Lock "cinder-quobyte-ab4b506a-ee81-4d45-ab7e-bb690ab70847" acquired by "delete_volume" :: waited 0.033s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:44 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38 Jul 21 19:18:44 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce15f1e-ebca-41e0-bb13-67c932a747d8]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab4b506a-ee81-4d45-ab7e-bb690ab70847 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:44 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:44 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:44 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab4b506a-ee81-4d45-ab7e-bb690ab70847 Jul 21 19:18:44 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:44 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38" returned: 0 in 0.461s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:44 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38 is being set with open permissions: ugo+rw Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:44 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.327s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:44 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] Deleted volume successfully. Jul 21 19:18:44 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38 Jul 21 19:18:44 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9ccb32e6-cae8-48c9-a50e-9c838ea4cd9c tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-30180767-aaa5-4415-a5cc-7aa0ff0a3757-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:44 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab4b506a-ee81-4d45-ab7e-bb690ab70847" returned: 0 in 0.521s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab4b506a-ee81-4d45-ab7e-bb690ab70847 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:44 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab4b506a-ee81-4d45-ab7e-bb690ab70847 Jul 21 19:18:44 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:44 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38" returned: 0 in 0.304s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:44 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.info Jul 21 19:18:44 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:44 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ab4b506a-ee81-4d45-ab7e-bb690ab70847" returned: 0 in 0.299s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] Lock "cinder-quobyte-ab4b506a-ee81-4d45-ab7e-bb690ab70847" released by "delete_volume" :: held 0.875s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:44 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] Created reservations ['12038b03-567b-41e3-a9c8-8f44ff1f9d0d', '6037cb3d-dd72-4594-b547-c05b74cbbf92', '04e44429-e83a-4168-9b6d-0ebee9fe82bc', '654aab98-732a-4e7e-b414-5c5184293fc5'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:45 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:45 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:45 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.info" returned: 0 in 0.357s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:45 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.info is being set with open permissions: ugo+rw Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "cinder-79a6b6bf-9d04-4579-8ca4-89966b4f9413-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:45 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.info Jul 21 19:18:45 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-79a6b6bf-9d04-4579-8ca4-89966b4f9413-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "cinder-quobyte-79a6b6bf-9d04-4579-8ca4-89966b4f9413" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-quobyte-79a6b6bf-9d04-4579-8ca4-89966b4f9413" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[920f814a-eec6-4309-8888-e5a2cb93b63d]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-79a6b6bf-9d04-4579-8ca4-89966b4f9413 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:45 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.373s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:45 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:45 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] Deleted volume successfully. Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.info" returned: 0 in 0.334s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:45 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-79a6b6bf-9d04-4579-8ca4-89966b4f9413 Jul 21 19:18:45 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.636s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f7a3e068-b350-4ff9-837d-af5704efa633 tempest-ProjectReaderTests-68191742 None] Lock "cinder-ab4b506a-ee81-4d45-ab7e-bb690ab70847-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:45 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-5b60839b-e559-4b93-8f94-5572af3d73a4 tempest-ProjectMemberTests-1649818385 None] Create snapshot completed successfully Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-542316b8-22e1-49e6-b7f4-11a99c128c38-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-542316b8-22e1-49e6-b7f4-11a99c128c38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-542316b8-22e1-49e6-b7f4-11a99c128c38" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-542316b8-22e1-49e6-b7f4-11a99c128c38" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] Deleting offline snapshot 542316b8-22e1-49e6-b7f4-11a99c128c38 of volume 81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] snapshot_file for this snap is: volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f76e2a4-3ff6-4347-856c-80de1313fb55]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:45 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-79a6b6bf-9d04-4579-8ca4-89966b4f9413" returned: 0 in 0.510s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-79a6b6bf-9d04-4579-8ca4-89966b4f9413 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:45 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-79a6b6bf-9d04-4579-8ca4-89966b4f9413 Jul 21 19:18:45 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:46 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38 Jul 21 19:18:46 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:46 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-79a6b6bf-9d04-4579-8ca4-89966b4f9413" returned: 0 in 0.394s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-quobyte-79a6b6bf-9d04-4579-8ca4-89966b4f9413" released by "delete_volume" :: held 0.968s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] Created reservations ['791041c9-0760-4d45-a87c-cebc62d43e90', '23b81cf7-f03e-4151-a104-2a5e96f866f4', '3f5a2544-40dc-4cb5-8864-9225fa9af8d5', '33d707b4-824b-4d41-8706-70a9881a7192'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:46 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38" returned: 0 in 0.558s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb483c4-90d6-4189-9745-a02b674020d1]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:46 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:46 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:46 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 Jul 21 19:18:46 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Flow 'volume_create_manager' (8363a2f4-e4c3-4d23-b957-c709893ccf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0affd490-4d51-4af7-980f-ec7f749020ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0affd490-4d51-4af7-980f-ec7f749020ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-553882268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2cc8884-254b-4148-b10c-35424b267327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4246671f17ed4b9c8c1249dc31915a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:47Z,use_quota=True,user_id='ee479a3d30e64e2ba900ecb9dba13fa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393aa1c1-0f11-4d6f-ad44-bf95be6c9814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393aa1c1-0f11-4d6f-ad44-bf95be6c9814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632fd89d-0f01-4dab-9171-68eeeade4488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632fd89d-0f01-4dab-9171-68eeeade4488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2cc8884-254b-4148-b10c-35424b267327', 'volume_name': 'volume-c2cc8884-254b-4148-b10c-35424b267327', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbaf6d14-5873-4178-b486-146b15a962aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbaf6d14-5873-4178-b486-146b15a962aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:46 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89905ed5-d01e-41f1-b265-b1d9abd4a01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:46 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Volume c2cc8884-254b-4148-b10c-35424b267327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2cc8884-254b-4148-b10c-35424b267327', 'volume_size': 1} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-553882268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2cc8884-254b-4148-b10c-35424b267327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4246671f17ed4b9c8c1249dc31915a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:47Z,use_quota=True,user_id='ee479a3d30e64e2ba900ecb9dba13fa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Creating volume c2cc8884-254b-4148-b10c-35424b267327 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:46 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c2cc8884-254b-4148-b10c-35424b267327 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.429s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:46 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:46 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] Deleted volume successfully. Jul 21 19:18:46 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21" returned: 0 in 0.557s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:47 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c2cc8884-254b-4148-b10c-35424b267327 1073741824 Jul 21 19:18:47 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:47 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38 Jul 21 19:18:47 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-27f82aab-1eb4-4940-9d31-7e0132a25082 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-79a6b6bf-9d04-4579-8ca4-89966b4f9413-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:47 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38" returned: 0 in 0.394s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:47 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38 Jul 21 19:18:47 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "cinder-762c290c-6d57-4536-8efa-d1c1b96280e1-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-762c290c-6d57-4536-8efa-d1c1b96280e1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:47 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c2cc8884-254b-4148-b10c-35424b267327 1073741824" returned: 0 in 0.586s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "cinder-quobyte-762c290c-6d57-4536-8efa-d1c1b96280e1" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c2cc8884-254b-4148-b10c-35424b267327 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-quobyte-762c290c-6d57-4536-8efa-d1c1b96280e1" acquired by "delete_volume" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:47 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c2cc8884-254b-4148-b10c-35424b267327 Jul 21 19:18:47 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:47 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1447509-bd8f-4f36-bfd1-e520c54ce1bf]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-762c290c-6d57-4536-8efa-d1c1b96280e1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:47 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21.542316b8-22e1-49e6-b7f4-11a99c128c38" returned: 0 in 0.385s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-542316b8-22e1-49e6-b7f4-11a99c128c38" released by "_delete_snapshot" :: held 2.047s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21" released by "delete_snapshot" :: held 2.078s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:47 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-762c290c-6d57-4536-8efa-d1c1b96280e1 Jul 21 19:18:47 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:47 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] Created reservations ['7378c922-03a6-4075-9788-fe23e1a67dda', 'afc64d01-33d1-4e7b-8588-06080e60a10a', '84381db6-f36c-4d4c-8985-0f7d6b8c20ab', '57a3ed59-012e-47dd-b125-cf3c2ec15118'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:48 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c2cc8884-254b-4148-b10c-35424b267327" returned: 0 in 0.375s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:48 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] Delete snapshot completed successfully. Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89905ed5-d01e-41f1-b265-b1d9abd4a01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2cc8884-254b-4148-b10c-35424b267327', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98729256-0506-4f38-97c1-a9eb2af5e44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-720999d1-63cf-4ba3-ad54-ced990c10d06 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-542316b8-22e1-49e6-b7f4-11a99c128c38-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:48 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Volume volume-c2cc8884-254b-4148-b10c-35424b267327 (c2cc8884-254b-4148-b10c-35424b267327): created successfully Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98729256-0506-4f38-97c1-a9eb2af5e44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Flow 'volume_create_manager' (8363a2f4-e4c3-4d23-b957-c709893ccf2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:48 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-6b1099c7-64cd-4897-b3ed-ef147c84433c tempest-ProjectReaderTests-68191742 None] Created volume successfully. Jul 21 19:18:48 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-762c290c-6d57-4536-8efa-d1c1b96280e1" returned: 0 in 0.489s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-762c290c-6d57-4536-8efa-d1c1b96280e1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:48 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-762c290c-6d57-4536-8efa-d1c1b96280e1 Jul 21 19:18:48 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:48 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-762c290c-6d57-4536-8efa-d1c1b96280e1" returned: 0 in 0.275s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-quobyte-762c290c-6d57-4536-8efa-d1c1b96280e1" released by "delete_volume" :: held 0.845s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] Created reservations ['35a429f7-685e-42bf-a1e7-e7df0420736a', 'd4874f63-43a2-4032-a5d0-32907561ac42', '78275475-55ce-45fb-9685-3ce0f37a5076', '47283c0f-4047-433d-a3ee-480c314414fb'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:48 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:48 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "cinder-909ae090-1baa-45ac-9f32-487a124117ac-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-909ae090-1baa-45ac-9f32-487a124117ac-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Flow 'volume_create_manager' (bfb23471-2e57-4df1-85ae-c5fa65b9e1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03a8ebd-dc75-482e-9bfd-2c72ae093853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03a8ebd-dc75-482e-9bfd-2c72ae093853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3727df0b-e3a6-426a-b967-4e114c2f4787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd5c6cd60fb43188f25d17048f195c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:49Z,use_quota=True,user_id='494000b389e14fd3a032fdf562c63653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbaad398-65de-447a-8308-cac55940cb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbaad398-65de-447a-8308-cac55940cb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b28f4b-98bd-4137-816b-10fd59f83b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b28f4b-98bd-4137-816b-10fd59f83b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3727df0b-e3a6-426a-b967-4e114c2f4787', 'volume_name': 'volume-3727df0b-e3a6-426a-b967-4e114c2f4787', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef43a06e-b0b8-4c24-b861-43472526da95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef43a06e-b0b8-4c24-b861-43472526da95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd87a2b-d2c2-4b40-b499-1ce0aa07aff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:48 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Volume 3727df0b-e3a6-426a-b967-4e114c2f4787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3727df0b-e3a6-426a-b967-4e114c2f4787', 'volume_size': 1} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3727df0b-e3a6-426a-b967-4e114c2f4787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd5c6cd60fb43188f25d17048f195c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:49Z,use_quota=True,user_id='494000b389e14fd3a032fdf562c63653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Creating volume 3727df0b-e3a6-426a-b967-4e114c2f4787 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:48 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3727df0b-e3a6-426a-b967-4e114c2f4787 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "cinder-quobyte-909ae090-1baa-45ac-9f32-487a124117ac" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-quobyte-909ae090-1baa-45ac-9f32-487a124117ac" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:48 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3727df0b-e3a6-426a-b967-4e114c2f4787 1073741824 Jul 21 19:18:48 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] Acquiring lock "cinder-c2cc8884-254b-4148-b10c-35424b267327-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b134329-36e0-4194-ac59-b60811afcb24]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-909ae090-1baa-45ac-9f32-487a124117ac {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:49 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.374s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:49 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] Deleted volume successfully. Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] Lock "cinder-c2cc8884-254b-4148-b10c-35424b267327-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-47083a6d-ac7d-4753-95e0-9d802fff0836 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-762c290c-6d57-4536-8efa-d1c1b96280e1-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] Acquiring lock "cinder-quobyte-c2cc8884-254b-4148-b10c-35424b267327" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] Lock "cinder-quobyte-c2cc8884-254b-4148-b10c-35424b267327" acquired by "delete_volume" :: waited 0.024s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:49 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-909ae090-1baa-45ac-9f32-487a124117ac Jul 21 19:18:49 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2b52bb-1e9a-42df-8485-8c76351b1431]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c2cc8884-254b-4148-b10c-35424b267327 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21" acquired by "delete_volume" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf6cc11-6a5b-49dc-b50f-3998b6431c2b]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:49 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c2cc8884-254b-4148-b10c-35424b267327 Jul 21 19:18:49 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:49 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:49 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 Jul 21 19:18:49 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-909ae090-1baa-45ac-9f32-487a124117ac" returned: 0 in 0.468s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-909ae090-1baa-45ac-9f32-487a124117ac {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:49 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-909ae090-1baa-45ac-9f32-487a124117ac Jul 21 19:18:49 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:49 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3727df0b-e3a6-426a-b967-4e114c2f4787 1073741824" returned: 0 in 0.702s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3727df0b-e3a6-426a-b967-4e114c2f4787 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:49 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c2cc8884-254b-4148-b10c-35424b267327" returned: 0 in 0.495s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c2cc8884-254b-4148-b10c-35424b267327 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:49 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3727df0b-e3a6-426a-b967-4e114c2f4787 Jul 21 19:18:49 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:49 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c2cc8884-254b-4148-b10c-35424b267327 Jul 21 19:18:49 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:49 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-909ae090-1baa-45ac-9f32-487a124117ac" returned: 0 in 0.344s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-quobyte-909ae090-1baa-45ac-9f32-487a124117ac" released by "delete_volume" :: held 0.912s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:49 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21" returned: 0 in 0.578s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:49 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21 Jul 21 19:18:49 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] Created reservations ['17679298-4a8d-4551-bd6f-847e4f8395ad', '928757e7-b259-4c7c-9ed0-69a017169ae6', '7bfb5780-9789-4e74-82ba-414e9c818f23', '431a179b-2150-40f2-9238-06e3cd006734'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:50 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3727df0b-e3a6-426a-b967-4e114c2f4787" returned: 0 in 0.348s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd87a2b-d2c2-4b40-b499-1ce0aa07aff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3727df0b-e3a6-426a-b967-4e114c2f4787', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ac0cc3-0e99-4ab2-820a-08ce152ed50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:50 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Volume volume-3727df0b-e3a6-426a-b967-4e114c2f4787 (3727df0b-e3a6-426a-b967-4e114c2f4787): created successfully Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ac0cc3-0e99-4ab2-820a-08ce152ed50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Flow 'volume_create_manager' (bfb23471-2e57-4df1-85ae-c5fa65b9e1fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:50 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:50 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-28ace4e0-a24a-401b-96f0-a4321c468cca tempest-CinderUnicodeTest-599200345 None] Created volume successfully. Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c2cc8884-254b-4148-b10c-35424b267327" returned: 0 in 0.416s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] Lock "cinder-quobyte-c2cc8884-254b-4148-b10c-35424b267327" released by "delete_volume" :: held 1.000s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:50 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:50 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] Created reservations ['d751861a-89e2-4c33-b736-a82becdcff6d', '480efec6-5476-4182-9d9e-837c0c74462a', '31346d20-0e6d-42e5-aef7-51ddc060f06c', '1791b708-090b-4a4f-986f-510d1eca4fd5'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:50 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21" returned: 0 in 0.339s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21" released by "delete_volume" :: held 1.004s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] Created reservations ['1269c928-554a-411b-9578-031fd93a72bc', 'cfb25a3d-398c-4231-85dd-4c8bf859d76f', '3d5a4c98-1d35-4ff5-8412-9d685aa13d98', '7f3470df-6451-404f-b956-44d805e330af'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:50 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:50 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:50 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.307s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:50 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] Deleted volume successfully. Jul 21 19:18:50 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:50 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a6f8d763-3659-4d7c-ad8e-4bbf8540c527 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-909ae090-1baa-45ac-9f32-487a124117ac-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:50 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.290s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:50 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] Deleted volume successfully. Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-871de8f7-2d13-43ed-853f-7c85431d595f tempest-ProjectReaderTests-68191742 None] Lock "cinder-c2cc8884-254b-4148-b10c-35424b267327-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:50 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.267s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:50 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] Deleted volume successfully. Jul 21 19:18:50 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d9987ef4-7994-4fa1-9b97-ae82619a2878 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-81a30df1-8a40-4cdf-bbbc-019f2e9a1a21-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "cinder-c65a4355-80a0-4ecf-8742-00ae171136ca-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-c65a4355-80a0-4ecf-8742-00ae171136ca-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "cinder-quobyte-c65a4355-80a0-4ecf-8742-00ae171136ca" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:51 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-quobyte-c65a4355-80a0-4ecf-8742-00ae171136ca" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:51 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fde1f13-473e-49c8-ad58-09b89e427ae2]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c65a4355-80a0-4ecf-8742-00ae171136ca {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:51 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c65a4355-80a0-4ecf-8742-00ae171136ca Jul 21 19:18:51 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:51 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c65a4355-80a0-4ecf-8742-00ae171136ca" returned: 0 in 0.494s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c65a4355-80a0-4ecf-8742-00ae171136ca {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:51 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c65a4355-80a0-4ecf-8742-00ae171136ca Jul 21 19:18:51 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:51 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:51 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Flow 'volume_create_manager' (decd6c3d-ce2d-45d7-a3a1-7a7adbc86c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9185c236-13ae-4b00-9904-7a8b5ff21377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-c65a4355-80a0-4ecf-8742-00ae171136ca" returned: 0 in 0.398s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9185c236-13ae-4b00-9904-7a8b5ff21377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1160639516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3eabddb-004d-4421-8c8e-ffe00c350784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd5c6cd60fb43188f25d17048f195c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:52Z,use_quota=True,user_id='494000b389e14fd3a032fdf562c63653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4190a0fc-d05f-42b9-aed2-2504e736d37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4190a0fc-d05f-42b9-aed2-2504e736d37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ab8ecd-99c7-4e50-961c-26479b56f747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ab8ecd-99c7-4e50-961c-26479b56f747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3eabddb-004d-4421-8c8e-ffe00c350784', 'volume_name': 'volume-a3eabddb-004d-4421-8c8e-ffe00c350784', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21969f56-3e43-4c6e-bee8-fbc9515900a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21969f56-3e43-4c6e-bee8-fbc9515900a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd41afa0-c7a9-4955-bbaf-028969a4a997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:52 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Volume a3eabddb-004d-4421-8c8e-ffe00c350784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3eabddb-004d-4421-8c8e-ffe00c350784', 'volume_size': 1} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1160639516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3eabddb-004d-4421-8c8e-ffe00c350784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd5c6cd60fb43188f25d17048f195c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:52Z,use_quota=True,user_id='494000b389e14fd3a032fdf562c63653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Creating volume a3eabddb-004d-4421-8c8e-ffe00c350784 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:52 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-quobyte-c65a4355-80a0-4ecf-8742-00ae171136ca" released by "delete_volume" :: held 1.025s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:52 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784 1073741824 Jul 21 19:18:52 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] Created reservations ['c841b559-ffd0-4766-8724-e278f7c74e9e', '22772a5e-fbc3-4e7d-8277-1ab570851af4', '610d9127-22d1-4b4f-b088-88d7857bae47', 'a1d485ff-b0a2-48ac-aa98-aeecb3bb3a63'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=295,cinder:SELECT=218,cinder:INSERT=77,cinder:DELETE=28 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:52 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:52 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (bd5c33ba-92db-4530-ba63-d79872f224c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32d3adb-4bc0-4b72-8a80-f1b60c2a71ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32d3adb-4bc0-4b72-8a80-f1b60c2a71ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1905630900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484965db-d93d-48b2-bcf6-a7ba9d5e30b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:52Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a330e35c-33cd-45e8-81b7-3e15381c871b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a330e35c-33cd-45e8-81b7-3e15381c871b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a094c2fb-033d-4c84-8a16-cd8ebf6cf094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a094c2fb-033d-4c84-8a16-cd8ebf6cf094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '484965db-d93d-48b2-bcf6-a7ba9d5e30b4', 'volume_name': 'volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc80ee8-f487-4800-a69c-723ff8e32278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc80ee8-f487-4800-a69c-723ff8e32278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4350cef9-e9a9-4f18-8ce4-fcc866433146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:52 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Volume 484965db-d93d-48b2-bcf6-a7ba9d5e30b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4', 'volume_size': 1} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:52 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.316s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:52 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] Deleted volume successfully. Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-d69b94d5-d468-4838-83a0-f68e876eaf47 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-c65a4355-80a0-4ecf-8742-00ae171136ca-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:52 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784 1073741824" returned: 0 in 0.670s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=213,cinder:UPDATE=297,cinder:INSERT=79,cinder:DELETE=25 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:18:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:52 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784 Jul 21 19:18:52 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:53 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784" returned: 0 in 0.319s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.694s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1905630900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484965db-d93d-48b2-bcf6-a7ba9d5e30b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:52Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Creating volume 484965db-d93d-48b2-bcf6-a7ba9d5e30b4 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:53 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd41afa0-c7a9-4955-bbaf-028969a4a997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3eabddb-004d-4421-8c8e-ffe00c350784', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:53 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4 1073741824 Jul 21 19:18:53 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eadeab46-178a-41a9-b52b-2af0ced98431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:53 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Volume volume-a3eabddb-004d-4421-8c8e-ffe00c350784 (a3eabddb-004d-4421-8c8e-ffe00c350784): created successfully Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eadeab46-178a-41a9-b52b-2af0ced98431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Flow 'volume_create_manager' (decd6c3d-ce2d-45d7-a3a1-7a7adbc86c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:53 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-96511e93-f60b-4682-91f7-314426772ded tempest-CinderUnicodeTest-599200345 None] Created volume successfully. Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "cinder-116666e8-e06a-4520-b68b-a692a9d427ed-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-116666e8-e06a-4520-b68b-a692a9d427ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "cinder-quobyte-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-quobyte-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "cinder-quobyte-116666e8-e06a-4520-b68b-a692a9d427ed" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-quobyte-116666e8-e06a-4520-b68b-a692a9d427ed" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] Deleting offline snapshot 116666e8-e06a-4520-b68b-a692a9d427ed of volume 7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] snapshot_file for this snap is: volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a166cf0b-0f70-49b7-903a-fdc33b204b26]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:53 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed Jul 21 19:18:53 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:53 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4 1073741824" returned: 0 in 0.596s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:53 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4 Jul 21 19:18:53 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:53 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed" returned: 0 in 0.477s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb4a5c2-6c79-44f5-94ee-4ff15e5e5c7b]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:54 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4" returned: 0 in 0.310s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:54 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 Jul 21 19:18:54 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4350cef9-e9a9-4f18-8ce4-fcc866433146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f111080-fe5e-4592-aac8-6e5b741677de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:54 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Volume volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4 (484965db-d93d-48b2-bcf6-a7ba9d5e30b4): created successfully Jul 21 19:18:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f111080-fe5e-4592-aac8-6e5b741677de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:54 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (bd5c33ba-92db-4530-ba63-d79872f224c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:54 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-97093600-65a7-4f28-91e6-966471d71d2b tempest-ProjectMemberTests-1649818385 None] Created volume successfully. Jul 21 19:18:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] Creating offline snapshot 3e31390e-42a6-4dbd-8c83-05ef19365d36 of volume a3eabddb-004d-4421-8c8e-ffe00c350784 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:18:54 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fc47ce-3742-4733-b6d8-701908884c2f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:54 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1" returned: 0 in 0.647s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:54 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed Jul 21 19:18:54 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:54 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784 Jul 21 19:18:54 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:55 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:55 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784" returned: 0 in 0.474s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed" returned: 0 in 0.462s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:55 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36 1G Jul 21 19:18:55 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:55 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed Jul 21 19:18:55 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:55 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1.116666e8-e06a-4520-b68b-a692a9d427ed" returned: 0 in 0.325s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-quobyte-116666e8-e06a-4520-b68b-a692a9d427ed" released by "_delete_snapshot" :: held 2.070s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-quobyte-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1" released by "delete_snapshot" :: held 2.102s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:55 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] Created reservations ['c332f147-fe9b-4bd5-b609-ac51c10320d1', '7bf5ab17-bc16-4126-9b4f-15fc6214c012', 'f8ce3058-c84d-429e-99ec-4a638c2dea3e', '21d156ae-0b70-43cb-bc63-e0cc9fc7b2e4'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:55 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36 1G" returned: 0 in 0.520s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3eabddb-004d-4421-8c8e-ffe00c350784 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:55 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3eabddb-004d-4421-8c8e-ffe00c350784 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36 Jul 21 19:18:55 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:55 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] Delete snapshot completed successfully. Jul 21 19:18:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-58df7d54-33e4-4b11-a17e-9a559f42dfcb tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-116666e8-e06a-4520-b68b-a692a9d427ed-delete_snapshot" released by "delete_snapshot" :: held 2.353s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:55 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3eabddb-004d-4421-8c8e-ffe00c350784 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36" returned: 0 in 0.349s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:55 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36 is being set with open permissions: ugo+rw Jul 21 19:18:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:56 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36 Jul 21 19:18:56 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:56 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36" returned: 0 in 0.286s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:56 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.info Jul 21 19:18:56 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:56 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.info" returned: 0 in 0.313s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:56 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.info is being set with open permissions: ugo+rw Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:56 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.info Jul 21 19:18:56 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "cinder-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Flow 'volume_create_manager' (6ad8c19b-bd09-413e-bc8e-06d043f38475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d58b674-daca-468d-b856-1d46fd026904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "cinder-quobyte-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d58b674-daca-468d-b856-1d46fd026904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1717551597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963610d2-5853-499b-a654-1610a389b027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ecb5360e24498ab519db605bf77473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:57Z,use_quota=True,user_id='30aee3adce4a466ab4b445396467daff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:56 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dfba4e-d5dc-4774-bf7a-0332d26decf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:56 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dfba4e-d5dc-4774-bf7a-0332d26decf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa10291-159f-485b-b7c7-901262c1acd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa10291-159f-485b-b7c7-901262c1acd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '963610d2-5853-499b-a654-1610a389b027', 'volume_name': 'volume-963610d2-5853-499b-a654-1610a389b027', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9478c85-c8e9-4d2e-8915-14da53592550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9478c85-c8e9-4d2e-8915-14da53592550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d81d2a-1d53-4f59-894c-dcd161e0ded6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:56 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Volume 963610d2-5853-499b-a654-1610a389b027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-963610d2-5853-499b-a654-1610a389b027', 'volume_size': 1} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-quobyte-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1" acquired by "delete_volume" :: waited 0.097s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c906ad-f7e4-4313-a377-0547ab6803c8]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:56 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.info" returned: 0 in 0.363s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.433s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.279s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] Creating offline snapshot f0296c0e-05e8-4411-9812-0be1e3267a47 of volume 484965db-d93d-48b2-bcf6-a7ba9d5e30b4 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[95510ad0-3269-4bd0-89d8-8eaaef4ed4de]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:57 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0b3b68a7-5bdc-4c1f-9999-492e4eea3c27 tempest-CinderUnicodeTest-599200345 None] Create snapshot completed successfully Jul 21 19:18:57 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 Jul 21 19:18:57 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:57 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.269s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:18:57 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4 Jul 21 19:18:57 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:57 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1" returned: 0 in 0.416s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:57 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1 Jul 21 19:18:57 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:57 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4" returned: 0 in 0.435s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:57 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47 1G Jul 21 19:18:57 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:57 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1" returned: 0 in 0.308s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-quobyte-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1" released by "delete_volume" :: held 0.802s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] Created reservations ['09e2a95c-2e72-475d-b283-974264b58ecc', '53cc1c5d-330b-484e-a8cc-90aa7d3bb8cf', 'd18da00a-1d30-4279-a50f-04bf1e71fdb7', '629b371c-cb2e-46b1-a1af-6892623065e0'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] Acquiring lock "cinder-3e31390e-42a6-4dbd-8c83-05ef19365d36-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] Lock "cinder-3e31390e-42a6-4dbd-8c83-05ef19365d36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] Acquiring lock "cinder-quobyte-a3eabddb-004d-4421-8c8e-ffe00c350784" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] Lock "cinder-quobyte-a3eabddb-004d-4421-8c8e-ffe00c350784" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] Acquiring lock "cinder-quobyte-3e31390e-42a6-4dbd-8c83-05ef19365d36" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] Lock "cinder-quobyte-3e31390e-42a6-4dbd-8c83-05ef19365d36" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] Deleting offline snapshot 3e31390e-42a6-4dbd-8c83-05ef19365d36 of volume a3eabddb-004d-4421-8c8e-ffe00c350784 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:18:58 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:18:58 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] snapshot_file for this snap is: volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6db0bda-1714-49c8-a01c-64d720300b62]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:58 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47 1G" returned: 0 in 0.608s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:58 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47 Jul 21 19:18:58 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:58 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36 Jul 21 19:18:58 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:58 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.338s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:58 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] Deleted volume successfully. Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cffcc1b0-7546-4e5c-8b90-447006017fa5 tempest-CreateVolumesFromSnapshotTest-128978447 None] Lock "cinder-7e6b5a20-7ff3-4b78-a2f5-b7ef1f29dde1-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:58 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36" returned: 0 in 0.467s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3eabddb-004d-4421-8c8e-ffe00c350784(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:18:58 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47" returned: 0 in 0.441s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:58 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47 is being set with open permissions: ugo+rw Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ac0552-4990-4009-9e89-d6940e257119]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:58 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47 Jul 21 19:18:58 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:58 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784 Jul 21 19:18:58 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:58 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47" returned: 0 in 0.309s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:58 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:58 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.info Jul 21 19:18:58 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:59 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784" returned: 0 in 0.462s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:59 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36 Jul 21 19:18:59 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:59 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.info" returned: 0 in 0.308s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:59 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.info is being set with open permissions: ugo+rw Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:59 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.info Jul 21 19:18:59 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:59 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36" returned: 0 in 0.459s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:59 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.info" returned: 0 in 0.299s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:59 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36 Jul 21 19:18:59 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.529s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.627s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1717551597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963610d2-5853-499b-a654-1610a389b027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ecb5360e24498ab519db605bf77473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:57Z,use_quota=True,user_id='30aee3adce4a466ab4b445396467daff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Creating volume 963610d2-5853-499b-a654-1610a389b027 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:59 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-963610d2-5853-499b-a654-1610a389b027 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:59 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-963610d2-5853-499b-a654-1610a389b027 1073741824 Jul 21 19:18:59 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:59 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-ee1f4119-c4bd-4dea-b21f-c5cfb445b773 tempest-ProjectMemberTests-1649818385 None] Create snapshot completed successfully Jul 21 19:18:59 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784.3e31390e-42a6-4dbd-8c83-05ef19365d36" returned: 0 in 0.318s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] Lock "cinder-quobyte-3e31390e-42a6-4dbd-8c83-05ef19365d36" released by "_delete_snapshot" :: held 1.854s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] Lock "cinder-quobyte-a3eabddb-004d-4421-8c8e-ffe00c350784" released by "delete_snapshot" :: held 1.919s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:59 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] Created reservations ['b12e49c6-c8bd-4c2d-a0e8-793b6ecf47e1', 'de4fa5e4-0221-427e-b213-c4189c2473e1', '4e9a991c-52a6-407a-a7ab-fa9ced1f2502', '4926331b-7c2a-4893-9c6b-a9df18dec30e'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-f0296c0e-05e8-4411-9812-0be1e3267a47-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] Lock "cinder-f0296c0e-05e8-4411-9812-0be1e3267a47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.108s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-484965db-d93d-48b2-bcf6-a7ba9d5e30b4" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:00 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] Delete snapshot completed successfully. Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-8999ae25-d7c6-47a1-bb9a-e9f65a19e597 tempest-CinderUnicodeTest-599200345 None] Lock "cinder-3e31390e-42a6-4dbd-8c83-05ef19365d36-delete_snapshot" released by "delete_snapshot" :: held 2.279s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-484965db-d93d-48b2-bcf6-a7ba9d5e30b4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-f0296c0e-05e8-4411-9812-0be1e3267a47" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-f0296c0e-05e8-4411-9812-0be1e3267a47" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] Deleting offline snapshot f0296c0e-05e8-4411-9812-0be1e3267a47 of volume 484965db-d93d-48b2-bcf6-a7ba9d5e30b4 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] snapshot_file for this snap is: volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd8b39a-24d1-41cc-a214-566f3deb30e9]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:00 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-963610d2-5853-499b-a654-1610a389b027 1073741824" returned: 0 in 0.721s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-963610d2-5853-499b-a654-1610a389b027 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:00 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-963610d2-5853-499b-a654-1610a389b027 Jul 21 19:19:00 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:00 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47 Jul 21 19:19:00 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:00 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-963610d2-5853-499b-a654-1610a389b027" returned: 0 in 0.333s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d81d2a-1d53-4f59-894c-dcd161e0ded6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-963610d2-5853-499b-a654-1610a389b027', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836f23dc-cd86-4bb1-a6f6-4f0750e629c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:00 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Volume volume-963610d2-5853-499b-a654-1610a389b027 (963610d2-5853-499b-a654-1610a389b027): created successfully Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836f23dc-cd86-4bb1-a6f6-4f0750e629c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Flow 'volume_create_manager' (6ad8c19b-bd09-413e-bc8e-06d043f38475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:00 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47" returned: 0 in 0.470s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:19:00 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-8151564e-67c6-46d3-89b4-4c3a5e923b49 tempest-ProjectReaderTests-629406909 None] Created volume successfully. Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a48a664-90f5-4e8e-9cdd-0a0caa41137e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:00 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:00 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4 Jul 21 19:19:00 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] Acquiring lock "cinder-a3eabddb-004d-4421-8c8e-ffe00c350784-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] Lock "cinder-a3eabddb-004d-4421-8c8e-ffe00c350784-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] Acquiring lock "cinder-quobyte-a3eabddb-004d-4421-8c8e-ffe00c350784" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] Lock "cinder-quobyte-a3eabddb-004d-4421-8c8e-ffe00c350784" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:01 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4" returned: 0 in 0.564s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa233ee-0e62-485f-b911-3c37d12722bd]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:01 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47 Jul 21 19:19:01 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:01 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784 Jul 21 19:19:01 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] Acquiring lock "cinder-963610d2-5853-499b-a654-1610a389b027-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] Lock "cinder-963610d2-5853-499b-a654-1610a389b027-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] Acquiring lock "cinder-quobyte-963610d2-5853-499b-a654-1610a389b027" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] Lock "cinder-quobyte-963610d2-5853-499b-a654-1610a389b027" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[05032c75-0636-4179-923a-1b6d86b69bf1]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-963610d2-5853-499b-a654-1610a389b027 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:01 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47" returned: 0 in 0.551s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:01 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784" returned: 0 in 0.556s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:01 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-963610d2-5853-499b-a654-1610a389b027 Jul 21 19:19:01 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47 Jul 21 19:19:01 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:01 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:01 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784 Jul 21 19:19:01 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:02 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-a3eabddb-004d-4421-8c8e-ffe00c350784" returned: 0 in 0.328s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:02 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4.f0296c0e-05e8-4411-9812-0be1e3267a47" returned: 0 in 0.372s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:02 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] Lock "cinder-quobyte-a3eabddb-004d-4421-8c8e-ffe00c350784" released by "delete_volume" :: held 1.010s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-963610d2-5853-499b-a654-1610a389b027" returned: 0 in 0.528s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-963610d2-5853-499b-a654-1610a389b027 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-f0296c0e-05e8-4411-9812-0be1e3267a47" released by "_delete_snapshot" :: held 2.111s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-484965db-d93d-48b2-bcf6-a7ba9d5e30b4" released by "delete_snapshot" :: held 2.152s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:02 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-963610d2-5853-499b-a654-1610a389b027 Jul 21 19:19:02 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] Created reservations ['4436cecd-b966-479c-8269-8058a21b9ba7', '91f3ab43-ae00-4cf6-bbfd-755778b1943f', '877062d8-0d5b-48eb-86c1-d8037b4b918b', 'be1c25b1-0cbd-4a58-89c4-10b2e7e5c39b'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] Created reservations ['d820adcc-5469-413b-a662-2b704e41c004', '5aa26faf-3393-4cd5-960a-294d00973b7a', 'a3ecdedc-b0ce-4725-b7af-efe36e41a137', 'eec17fab-f7b7-414e-9df3-ea6deb425e69'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:02 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] Delete snapshot completed successfully. Jul 21 19:19:02 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:19:02 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-b9ac62f2-6b7f-4d6d-a3ea-281609dbb9ee tempest-ProjectMemberTests-1649818385 None] Lock "cinder-f0296c0e-05e8-4411-9812-0be1e3267a47-delete_snapshot" released by "delete_snapshot" :: held 2.446s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:02 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-963610d2-5853-499b-a654-1610a389b027" returned: 0 in 0.364s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] Lock "cinder-quobyte-963610d2-5853-499b-a654-1610a389b027" released by "delete_volume" :: held 0.952s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] Created reservations ['1f2bc5f3-d623-4d4f-8e9b-98f2434cec58', 'cd4e7463-42e0-4771-a078-10d4cc604028', '0d8f62ee-b8fd-441c-9b4d-2f91e93dad9a', 'b03408b4-881c-47b2-b760-67678624c5a5'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:02 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.335s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:02 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] Deleted volume successfully. Jul 21 19:19:02 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:19:02 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:02 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-41d88a79-75a8-4306-a95c-2cd3213ca8ba tempest-CinderUnicodeTest-599200345 None] Lock "cinder-a3eabddb-004d-4421-8c8e-ffe00c350784-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:03 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.313s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:03 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:03 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] Deleted volume successfully. Jul 21 19:19:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-14792b68-8038-44ae-a1a6-8904c04ea073 tempest-ProjectReaderTests-629406909 None] Lock "cinder-963610d2-5853-499b-a654-1610a389b027-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-484965db-d93d-48b2-bcf6-a7ba9d5e30b4-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-484965db-d93d-48b2-bcf6-a7ba9d5e30b4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-484965db-d93d-48b2-bcf6-a7ba9d5e30b4" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-484965db-d93d-48b2-bcf6-a7ba9d5e30b4" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:03 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ea6251-f6f3-4332-acb9-63c15b9a41d1]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] Acquiring lock "cinder-3727df0b-e3a6-426a-b967-4e114c2f4787-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] Lock "cinder-3727df0b-e3a6-426a-b967-4e114c2f4787-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] Acquiring lock "cinder-quobyte-3727df0b-e3a6-426a-b967-4e114c2f4787" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:03 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] Lock "cinder-quobyte-3727df0b-e3a6-426a-b967-4e114c2f4787" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:03 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37182b4-91c2-4ef1-ab1d-704c26f2ca6f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3727df0b-e3a6-426a-b967-4e114c2f4787 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:03 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4 Jul 21 19:19:03 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:03 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3727df0b-e3a6-426a-b967-4e114c2f4787 Jul 21 19:19:03 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:04 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4" returned: 0 in 0.542s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:04 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4 Jul 21 19:19:04 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:04 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3727df0b-e3a6-426a-b967-4e114c2f4787" returned: 0 in 0.536s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3727df0b-e3a6-426a-b967-4e114c2f4787 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:04 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3727df0b-e3a6-426a-b967-4e114c2f4787 Jul 21 19:19:04 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:04 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-484965db-d93d-48b2-bcf6-a7ba9d5e30b4" returned: 0 in 0.342s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-484965db-d93d-48b2-bcf6-a7ba9d5e30b4" released by "delete_volume" :: held 0.983s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:04 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-3727df0b-e3a6-426a-b967-4e114c2f4787" returned: 0 in 0.321s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] Lock "cinder-quobyte-3727df0b-e3a6-426a-b967-4e114c2f4787" released by "delete_volume" :: held 0.918s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] Created reservations ['ae498ba0-905a-4fae-bae7-83324094f8cf', '442bb8df-ce0c-4f70-8ecd-b5dc9715c79b', 'f7a1e56d-768e-45bb-9154-77c9cfb266dc', '58834aa7-345c-4d1d-a796-4e3f9b270c1f'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Flow 'volume_create_manager' (9a83bec6-0d2d-437b-a87c-749d22fcd4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2bb5f6c-7f39-4875-a6a8-80392bd3d2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2bb5f6c-7f39-4875-a6a8-80392bd3d2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1250471816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec662078-aade-4fd8-8498-213b5be6061f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ecb5360e24498ab519db605bf77473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:05Z,use_quota=True,user_id='30aee3adce4a466ab4b445396467daff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47293f7-bc76-458f-9cec-159440ba0101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47293f7-bc76-458f-9cec-159440ba0101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbf2503-2fc8-48d8-9027-c699d80959b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbf2503-2fc8-48d8-9027-c699d80959b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec662078-aade-4fd8-8498-213b5be6061f', 'volume_name': 'volume-ec662078-aade-4fd8-8498-213b5be6061f', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d523644-814f-4ed9-81a7-758a6546aa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d523644-814f-4ed9-81a7-758a6546aa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b64501-4837-41be-aded-f0e42cec3956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:04 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Volume ec662078-aade-4fd8-8498-213b5be6061f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec662078-aade-4fd8-8498-213b5be6061f', 'volume_size': 1} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1250471816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec662078-aade-4fd8-8498-213b5be6061f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ecb5360e24498ab519db605bf77473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:05Z,use_quota=True,user_id='30aee3adce4a466ab4b445396467daff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Creating volume ec662078-aade-4fd8-8498-213b5be6061f {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:04 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ec662078-aade-4fd8-8498-213b5be6061f 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:04 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ec662078-aade-4fd8-8498-213b5be6061f 1073741824 Jul 21 19:19:04 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:04 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:19:04 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] Created reservations ['92f40798-03f6-4544-84db-75055b8a712d', '0306b3a1-540a-4aed-9f39-47261ca5c4d7', '7d27e24a-83ba-424d-93de-46131274a4c3', '46977a87-ba3c-442e-885c-521e834c890b'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:04 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:19:04 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:05 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.296s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:05 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:05 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] Deleted volume successfully. Jul 21 19:19:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-eb59257d-69fc-44b3-b023-4bfc0315aa70 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-484965db-d93d-48b2-bcf6-a7ba9d5e30b4-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:05 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.322s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:05 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:05 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] Deleted volume successfully. Jul 21 19:19:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a261a1e6-2e47-48d5-992d-020c6477ee24 tempest-CinderUnicodeTest-599200345 None] Lock "cinder-3727df0b-e3a6-426a-b967-4e114c2f4787-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:05 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ec662078-aade-4fd8-8498-213b5be6061f 1073741824" returned: 0 in 0.536s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ec662078-aade-4fd8-8498-213b5be6061f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:05 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ec662078-aade-4fd8-8498-213b5be6061f Jul 21 19:19:05 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:05 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ec662078-aade-4fd8-8498-213b5be6061f" returned: 0 in 0.282s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b64501-4837-41be-aded-f0e42cec3956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec662078-aade-4fd8-8498-213b5be6061f', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9415c5-6798-4341-ae59-e14923253fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:05 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Volume volume-ec662078-aade-4fd8-8498-213b5be6061f (ec662078-aade-4fd8-8498-213b5be6061f): created successfully Jul 21 19:19:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9415c5-6798-4341-ae59-e14923253fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Flow 'volume_create_manager' (9a83bec6-0d2d-437b-a87c-749d22fcd4f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:05 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-3e0a0f68-5cfb-40fe-a727-5cc5b4de26e2 tempest-ProjectReaderTests-629406909 None] Created volume successfully. Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (deac1de1-9ada-4329-aa2e-3a1296e43bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f5faad-aa2d-47da-ba2b-ee44584635ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f5faad-aa2d-47da-ba2b-ee44584635ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1312820483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5deabac9-27f1-4a7a-bfcd-edd1d195e17f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:06Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97b6961-732a-425d-9348-ae8bb8aeb8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97b6961-732a-425d-9348-ae8bb8aeb8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b99cf135-ef80-4e4e-8bd4-e17e0231e97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b99cf135-ef80-4e4e-8bd4-e17e0231e97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5deabac9-27f1-4a7a-bfcd-edd1d195e17f', 'volume_name': 'volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e027e41f-91be-40b4-bb33-fc637a3a6e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e027e41f-91be-40b4-bb33-fc637a3a6e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064cd7a4-ef8e-4a97-9036-e94a681c782c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:06 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Volume 5deabac9-27f1-4a7a-bfcd-edd1d195e17f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f', 'volume_size': 1} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1312820483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5deabac9-27f1-4a7a-bfcd-edd1d195e17f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:06Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Creating volume 5deabac9-27f1-4a7a-bfcd-edd1d195e17f {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:06 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:06 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f 1073741824 Jul 21 19:19:06 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] Acquiring lock "cinder-ec662078-aade-4fd8-8498-213b5be6061f-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] Lock "cinder-ec662078-aade-4fd8-8498-213b5be6061f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] Acquiring lock "cinder-quobyte-ec662078-aade-4fd8-8498-213b5be6061f" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] Lock "cinder-quobyte-ec662078-aade-4fd8-8498-213b5be6061f" acquired by "delete_volume" :: waited 0.027s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74abc41-9462-423a-a119-7760003011cb]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ec662078-aade-4fd8-8498-213b5be6061f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:07 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f 1073741824" returned: 0 in 0.613s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:07 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ec662078-aade-4fd8-8498-213b5be6061f Jul 21 19:19:07 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:07 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f Jul 21 19:19:07 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:07 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ec662078-aade-4fd8-8498-213b5be6061f" returned: 0 in 0.473s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ec662078-aade-4fd8-8498-213b5be6061f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:07 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f" returned: 0 in 0.344s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:07 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ec662078-aade-4fd8-8498-213b5be6061f Jul 21 19:19:07 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064cd7a4-ef8e-4a97-9036-e94a681c782c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05da1b36-7820-4653-85d6-ed6822485da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:07 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Volume volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f (5deabac9-27f1-4a7a-bfcd-edd1d195e17f): created successfully Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05da1b36-7820-4653-85d6-ed6822485da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (deac1de1-9ada-4329-aa2e-3a1296e43bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:07 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-ffe0756a-47bd-47e9-9e08-d418c86d7cd0 tempest-ProjectMemberTests-1649818385 None] Created volume successfully. Jul 21 19:19:07 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-ec662078-aade-4fd8-8498-213b5be6061f" returned: 0 in 0.362s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] Lock "cinder-quobyte-ec662078-aade-4fd8-8498-213b5be6061f" released by "delete_volume" :: held 0.894s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] Created reservations ['6f4becd4-f95b-4d46-bec5-689ce72f2a66', '08b82c71-4eca-46bb-9893-24f1c70bfcfe', '7b9d0d40-7936-4c98-b193-1cc4a8e31d9b', 'eec983e8-63a6-42af-8751-9d77773b4e23'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:08 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:19:08 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:08 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.410s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:08 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] Deleted volume successfully. Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-7cbd20d9-31cd-4085-81a1-0b33254b1c60 tempest-ProjectReaderTests-629406909 None] Lock "cinder-ec662078-aade-4fd8-8498-213b5be6061f-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Flow 'volume_create_manager' (44db1874-308a-4e12-ab5d-6418d41d7be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aeacb29-8906-4b06-b216-05720cb030e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] Creating offline snapshot c228dc2d-0baf-4462-90ac-109411370843 of volume 5deabac9-27f1-4a7a-bfcd-edd1d195e17f {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aeacb29-8906-4b06-b216-05720cb030e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1250773686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b137415d-2f57-400b-a32f-1ae98f19acb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ecb5360e24498ab519db605bf77473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:09Z,use_quota=True,user_id='30aee3adce4a466ab4b445396467daff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47cfe4b-f02d-4f67-a05c-551021f0e7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47cfe4b-f02d-4f67-a05c-551021f0e7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d195aa-38bc-4f23-9600-e628947f503f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d195aa-38bc-4f23-9600-e628947f503f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b137415d-2f57-400b-a32f-1ae98f19acb5', 'volume_name': 'volume-b137415d-2f57-400b-a32f-1ae98f19acb5', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9f50bc-40ae-4fa7-bad7-dcbfa64e0c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9f50bc-40ae-4fa7-bad7-dcbfa64e0c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (928648cd-f67c-4292-885c-3628333b4f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:08 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Volume b137415d-2f57-400b-a32f-1ae98f19acb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b137415d-2f57-400b-a32f-1ae98f19acb5', 'volume_size': 1} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[13856f2d-bf6f-4232-8d6d-455be4a7393c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:09 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f Jul 21 19:19:09 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:09 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f" returned: 0 in 0.428s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:09 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843 1G Jul 21 19:19:09 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:09 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843 1G" returned: 0 in 0.549s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:09 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843 Jul 21 19:19:09 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:10 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843" returned: 0 in 0.329s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:10 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843 is being set with open permissions: ugo+rw Jul 21 19:19:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:10 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843 Jul 21 19:19:10 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-707443d2-88e4-41d9-a16b-d9de192477f2 tempest-ProjectAdminTests-1568448760 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87570) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 19:19:10 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843" returned: 0 in 0.277s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:10 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.info Jul 21 19:19:10 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:10 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.info" returned: 0 in 0.289s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:10 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.info is being set with open permissions: ugo+rw Jul 21 19:19:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:10 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.info Jul 21 19:19:10 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:11 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.info" returned: 0 in 0.273s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.347s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.228s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1250773686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b137415d-2f57-400b-a32f-1ae98f19acb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ecb5360e24498ab519db605bf77473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:09Z,use_quota=True,user_id='30aee3adce4a466ab4b445396467daff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Creating volume b137415d-2f57-400b-a32f-1ae98f19acb5 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:11 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b137415d-2f57-400b-a32f-1ae98f19acb5 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:11 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b137415d-2f57-400b-a32f-1ae98f19acb5 1073741824 Jul 21 19:19:11 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:11 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-b73a1681-01e9-472a-b75c-bd831710605a tempest-ProjectMemberTests-1649818385 None] Create snapshot completed successfully Jul 21 19:19:11 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b137415d-2f57-400b-a32f-1ae98f19acb5 1073741824" returned: 0 in 0.596s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b137415d-2f57-400b-a32f-1ae98f19acb5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:11 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b137415d-2f57-400b-a32f-1ae98f19acb5 Jul 21 19:19:11 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-c228dc2d-0baf-4462-90ac-109411370843-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-c228dc2d-0baf-4462-90ac-109411370843-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-5deabac9-27f1-4a7a-bfcd-edd1d195e17f" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-5deabac9-27f1-4a7a-bfcd-edd1d195e17f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-c228dc2d-0baf-4462-90ac-109411370843" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-c228dc2d-0baf-4462-90ac-109411370843" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:12 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] Deleting offline snapshot c228dc2d-0baf-4462-90ac-109411370843 of volume 5deabac9-27f1-4a7a-bfcd-edd1d195e17f {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:19:12 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] snapshot_file for this snap is: volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:19:12 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aeff69e-93c1-459d-8e1f-e7500a36cd20]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:12 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b137415d-2f57-400b-a32f-1ae98f19acb5" returned: 0 in 0.364s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:12 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:12 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843 Jul 21 19:19:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (928648cd-f67c-4292-885c-3628333b4f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b137415d-2f57-400b-a32f-1ae98f19acb5', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:12 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8759df96-3ec6-4b28-b8f8-2a4d001af6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:12 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Volume volume-b137415d-2f57-400b-a32f-1ae98f19acb5 (b137415d-2f57-400b-a32f-1ae98f19acb5): created successfully Jul 21 19:19:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8759df96-3ec6-4b28-b8f8-2a4d001af6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:12 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Flow 'volume_create_manager' (44db1874-308a-4e12-ab5d-6418d41d7be3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:12 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-17ae0a49-0af1-44b2-82e9-b6e1207a325e tempest-ProjectReaderTests-629406909 None] Created volume successfully. Jul 21 19:19:12 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843" returned: 0 in 0.496s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:12 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:19:12 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca133bc-e415-482d-91f6-1a27b115539f]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:12 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f Jul 21 19:19:12 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] Acquiring lock "cinder-b137415d-2f57-400b-a32f-1ae98f19acb5-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] Lock "cinder-b137415d-2f57-400b-a32f-1ae98f19acb5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:13 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f" returned: 0 in 0.521s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] Acquiring lock "cinder-quobyte-b137415d-2f57-400b-a32f-1ae98f19acb5" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:13 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843 Jul 21 19:19:13 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] Lock "cinder-quobyte-b137415d-2f57-400b-a32f-1ae98f19acb5" acquired by "delete_volume" :: waited 0.026s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:13 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[e420a7d5-39c6-4f4c-aa3f-ad7702503124]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b137415d-2f57-400b-a32f-1ae98f19acb5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:13 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b137415d-2f57-400b-a32f-1ae98f19acb5 Jul 21 19:19:13 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:13 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843" returned: 0 in 0.542s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:13 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843 Jul 21 19:19:13 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:13 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b137415d-2f57-400b-a32f-1ae98f19acb5" returned: 0 in 0.500s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b137415d-2f57-400b-a32f-1ae98f19acb5 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:13 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b137415d-2f57-400b-a32f-1ae98f19acb5 Jul 21 19:19:13 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:14 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f.c228dc2d-0baf-4462-90ac-109411370843" returned: 0 in 0.410s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:14 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-b137415d-2f57-400b-a32f-1ae98f19acb5" returned: 0 in 0.384s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:14 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-c228dc2d-0baf-4462-90ac-109411370843" released by "_delete_snapshot" :: held 2.128s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:14 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-5deabac9-27f1-4a7a-bfcd-edd1d195e17f" released by "delete_snapshot" :: held 2.172s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:14 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] Lock "cinder-quobyte-b137415d-2f57-400b-a32f-1ae98f19acb5" released by "delete_volume" :: held 0.977s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:14 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] Created reservations ['22081d46-83eb-46c4-9446-7f0962100ba0', '80194126-85d8-4a3a-a5e9-c211fb5eceb9', '0c581670-73ee-4463-876d-219d74df5fa9', 'af615689-1437-42b6-b886-e2d15c4abe15'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:14 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] Created reservations ['3c79cec6-2e45-4d0c-b986-e3b345d9b73a', 'c69d1735-71a6-4443-94b7-279e1f06a6bf', '51c6f1f8-bd68-407b-a187-6624c0332e33', '519a6778-0be6-4546-8d79-bc0cf65748ff'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:14 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:14 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] Delete snapshot completed successfully. Jul 21 19:19:14 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:19:14 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:14 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-67769b01-c197-48ee-aaff-1034eb6f2285 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-c228dc2d-0baf-4462-90ac-109411370843-delete_snapshot" released by "delete_snapshot" :: held 2.512s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:14 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.355s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:14 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:14 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] Deleted volume successfully. Jul 21 19:19:14 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-53623269-9e44-4fca-914b-94bfc67ad9cf tempest-ProjectReaderTests-629406909 None] Lock "cinder-b137415d-2f57-400b-a32f-1ae98f19acb5-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-5deabac9-27f1-4a7a-bfcd-edd1d195e17f-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-5deabac9-27f1-4a7a-bfcd-edd1d195e17f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-5deabac9-27f1-4a7a-bfcd-edd1d195e17f" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-5deabac9-27f1-4a7a-bfcd-edd1d195e17f" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:15 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e93db91-a2ab-45f9-b8a1-315836cdb458]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:15 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f Jul 21 19:19:15 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:15 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f" returned: 0 in 0.492s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:15 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f Jul 21 19:19:15 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Flow 'volume_create_manager' (9e43be0e-22af-41fe-b695-54efa55c09d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ecfa77e-2957-4244-8bf6-de38c0b3b6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ecfa77e-2957-4244-8bf6-de38c0b3b6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1195968674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9713826e-d01c-4ed2-a184-dc07ab7db6af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ecb5360e24498ab519db605bf77473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:16Z,use_quota=True,user_id='30aee3adce4a466ab4b445396467daff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d44ba67-b206-45cc-a0ee-a8f6aeabbbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d44ba67-b206-45cc-a0ee-a8f6aeabbbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f613b11-5cfd-4ca0-b4e2-be0b688db967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f613b11-5cfd-4ca0-b4e2-be0b688db967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9713826e-d01c-4ed2-a184-dc07ab7db6af', 'volume_name': 'volume-9713826e-d01c-4ed2-a184-dc07ab7db6af', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65e3125-620f-4e0d-90f9-3c44d80298dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65e3125-620f-4e0d-90f9-3c44d80298dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf30c3dc-208a-4078-a9ba-acd17d67d780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:16 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Volume 9713826e-d01c-4ed2-a184-dc07ab7db6af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9713826e-d01c-4ed2-a184-dc07ab7db6af', 'volume_size': 1} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1195968674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9713826e-d01c-4ed2-a184-dc07ab7db6af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ecb5360e24498ab519db605bf77473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:16Z,use_quota=True,user_id='30aee3adce4a466ab4b445396467daff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Creating volume 9713826e-d01c-4ed2-a184-dc07ab7db6af {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:16 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9713826e-d01c-4ed2-a184-dc07ab7db6af 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:16 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5deabac9-27f1-4a7a-bfcd-edd1d195e17f" returned: 0 in 0.268s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:16 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9713826e-d01c-4ed2-a184-dc07ab7db6af 1073741824 Jul 21 19:19:16 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-5deabac9-27f1-4a7a-bfcd-edd1d195e17f" released by "delete_volume" :: held 0.854s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] Created reservations ['0860f46f-6f4f-4b24-a772-3d720316a23a', 'b193bfe7-fac2-4f5a-b8aa-80402f96e21f', 'be478c43-8601-49a8-a9a6-42b2cb4e9cc6', '0f161615-61c4-4747-90c7-5ed68a2f7c90'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:16 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:19:16 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:16 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.380s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:16 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] Deleted volume successfully. Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-6f1bfa97-37b3-44a0-a7c9-7e6c73618344 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-5deabac9-27f1-4a7a-bfcd-edd1d195e17f-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:16 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9713826e-d01c-4ed2-a184-dc07ab7db6af 1073741824" returned: 0 in 0.701s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9713826e-d01c-4ed2-a184-dc07ab7db6af {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:16 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9713826e-d01c-4ed2-a184-dc07ab7db6af Jul 21 19:19:16 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (d74c7d20-d130-44e8-8e34-1cfe1ab48c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa9b752-c084-4daf-848a-54b4989537c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa9b752-c084-4daf-848a-54b4989537c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290480320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02068882-78c1-42f6-9b81-74bb44efb6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:17Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528c176c-a971-474c-8ec1-68bd1fcda1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528c176c-a971-474c-8ec1-68bd1fcda1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d40b1b0-1485-4222-9777-60af1f1990dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d40b1b0-1485-4222-9777-60af1f1990dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02068882-78c1-42f6-9b81-74bb44efb6d3', 'volume_name': 'volume-02068882-78c1-42f6-9b81-74bb44efb6d3', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e7947f-da12-4b74-85d1-55e0ae91214f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e7947f-da12-4b74-85d1-55e0ae91214f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b081b0-7119-4038-b632-01d354190955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:17 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Volume 02068882-78c1-42f6-9b81-74bb44efb6d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02068882-78c1-42f6-9b81-74bb44efb6d3', 'volume_size': 1} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:17 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9713826e-d01c-4ed2-a184-dc07ab7db6af" returned: 0 in 0.372s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.035s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290480320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02068882-78c1-42f6-9b81-74bb44efb6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:17Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Creating volume 02068882-78c1-42f6-9b81-74bb44efb6d3 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:17 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf30c3dc-208a-4078-a9ba-acd17d67d780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9713826e-d01c-4ed2-a184-dc07ab7db6af', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df103fe8-2afa-4844-9457-fda3f3224346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:17 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3 1073741824 Jul 21 19:19:17 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:17 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Volume volume-9713826e-d01c-4ed2-a184-dc07ab7db6af (9713826e-d01c-4ed2-a184-dc07ab7db6af): created successfully Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df103fe8-2afa-4844-9457-fda3f3224346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Flow 'volume_create_manager' (9e43be0e-22af-41fe-b695-54efa55c09d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:17 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-262b3aa6-6a31-4ab6-9116-dc734a3310b2 tempest-ProjectReaderTests-629406909 None] Created volume successfully. Jul 21 19:19:17 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3 1073741824" returned: 0 in 0.563s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:17 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3 Jul 21 19:19:17 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:18 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3" returned: 0 in 0.298s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b081b0-7119-4038-b632-01d354190955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02068882-78c1-42f6-9b81-74bb44efb6d3', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f14b3d8-c789-4ec3-9582-250c00fd8e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:18 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Volume volume-02068882-78c1-42f6-9b81-74bb44efb6d3 (02068882-78c1-42f6-9b81-74bb44efb6d3): created successfully Jul 21 19:19:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f14b3d8-c789-4ec3-9582-250c00fd8e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:18 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (d74c7d20-d130-44e8-8e34-1cfe1ab48c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] Acquiring lock "cinder-9713826e-d01c-4ed2-a184-dc07ab7db6af-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:18 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-ae1d9abe-f87e-413b-baef-4d2b8b811f0f tempest-ProjectMemberTests-1649818385 None] Created volume successfully. Jul 21 19:19:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] Lock "cinder-9713826e-d01c-4ed2-a184-dc07ab7db6af-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] Acquiring lock "cinder-quobyte-9713826e-d01c-4ed2-a184-dc07ab7db6af" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:18 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] Lock "cinder-quobyte-9713826e-d01c-4ed2-a184-dc07ab7db6af" acquired by "delete_volume" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:18 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae16535b-2d0b-4474-ac02-2bb07f63c38c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9713826e-d01c-4ed2-a184-dc07ab7db6af {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:18 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9713826e-d01c-4ed2-a184-dc07ab7db6af Jul 21 19:19:18 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:18 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9713826e-d01c-4ed2-a184-dc07ab7db6af" returned: 0 in 0.449s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9713826e-d01c-4ed2-a184-dc07ab7db6af {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:18 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9713826e-d01c-4ed2-a184-dc07ab7db6af Jul 21 19:19:18 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:19 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-9713826e-d01c-4ed2-a184-dc07ab7db6af" returned: 0 in 0.360s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] Lock "cinder-quobyte-9713826e-d01c-4ed2-a184-dc07ab7db6af" released by "delete_volume" :: held 0.858s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:19 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] Created reservations ['ad21d2dd-6e2a-4c29-ac25-166ee2aff650', '3485d99a-3c19-4cc9-b7be-e9c1a0d4d50d', '959c17dd-e51b-4b35-8479-549e6e8f9fda', '136cab94-2cb1-4591-9707-c1a8550a007e'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:19 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:19 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:19 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:19:19 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:19 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] Creating offline snapshot 5503ee7f-14e9-4339-b944-bab06b439458 of volume 02068882-78c1-42f6-9b81-74bb44efb6d3 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:19:19 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f8c002-bb8d-4396-9603-aff9f2b48463]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:19 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3 Jul 21 19:19:19 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:19 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.429s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:19 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:19 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] Deleted volume successfully. Jul 21 19:19:19 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-32eb253e-4b31-4733-aa36-2ebaf75400f5 tempest-ProjectReaderTests-629406909 None] Lock "cinder-9713826e-d01c-4ed2-a184-dc07ab7db6af-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:20 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3" returned: 0 in 0.519s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:20 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458 1G Jul 21 19:19:20 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:20 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458 1G" returned: 0 in 0.551s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02068882-78c1-42f6-9b81-74bb44efb6d3 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:20 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02068882-78c1-42f6-9b81-74bb44efb6d3 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458 Jul 21 19:19:20 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:21 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02068882-78c1-42f6-9b81-74bb44efb6d3 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458" returned: 0 in 0.453s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:21 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458 is being set with open permissions: ugo+rw Jul 21 19:19:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:21 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458 Jul 21 19:19:21 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:21 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458" returned: 0 in 0.358s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:21 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.info Jul 21 19:19:21 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:21 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.info" returned: 0 in 0.318s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:21 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.info is being set with open permissions: ugo+rw Jul 21 19:19:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:22 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.info Jul 21 19:19:22 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:22 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.info" returned: 0 in 0.387s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.762s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:22 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-c2cf52b3-ad87-4d97-8059-1a14c69c00d2 tempest-ProjectMemberTests-1649818385 None] Create snapshot completed successfully Jul 21 19:19:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-5503ee7f-14e9-4339-b944-bab06b439458-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-5503ee7f-14e9-4339-b944-bab06b439458-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-02068882-78c1-42f6-9b81-74bb44efb6d3" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-02068882-78c1-42f6-9b81-74bb44efb6d3" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-5503ee7f-14e9-4339-b944-bab06b439458" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-5503ee7f-14e9-4339-b944-bab06b439458" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] Deleting offline snapshot 5503ee7f-14e9-4339-b944-bab06b439458 of volume 02068882-78c1-42f6-9b81-74bb44efb6d3 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:19:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] snapshot_file for this snap is: volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:19:23 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[62efc472-7252-4fd7-86bc-d87a4d80ff40]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:23 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458 Jul 21 19:19:23 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:23 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458" returned: 0 in 0.441s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02068882-78c1-42f6-9b81-74bb44efb6d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:19:23 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd474039-0331-4097-8677-dd6b18ba467c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:23 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3 Jul 21 19:19:23 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:23 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3" returned: 0 in 0.433s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:24 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458 Jul 21 19:19:24 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:24 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458" returned: 0 in 0.387s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:24 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458 Jul 21 19:19:24 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:24 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3.5503ee7f-14e9-4339-b944-bab06b439458" returned: 0 in 0.279s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-5503ee7f-14e9-4339-b944-bab06b439458" released by "_delete_snapshot" :: held 1.671s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-02068882-78c1-42f6-9b81-74bb44efb6d3" released by "delete_snapshot" :: held 1.703s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:24 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] Created reservations ['e4938f4c-d981-468a-9321-c6e2537d65e8', '00f169b4-d136-47d1-a01f-757acf5a70bc', '16d43dbc-0f2a-4b20-bc4c-ea491c319005', 'f4ca01f4-336b-4c9f-bd57-78896eb5e725'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:24 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] Delete snapshot completed successfully. Jul 21 19:19:24 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9d6c851d-8305-4c99-886a-9c34a2fa8ed2 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-5503ee7f-14e9-4339-b944-bab06b439458-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-02068882-78c1-42f6-9b81-74bb44efb6d3-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-02068882-78c1-42f6-9b81-74bb44efb6d3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-02068882-78c1-42f6-9b81-74bb44efb6d3" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:25 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-02068882-78c1-42f6-9b81-74bb44efb6d3" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:25 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[933857e9-7f7b-4c3f-b6bf-99c170b1d4b6]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:25 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3 Jul 21 19:19:25 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:25 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3" returned: 0 in 0.454s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:25 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3 Jul 21 19:19:25 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:26 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-02068882-78c1-42f6-9b81-74bb44efb6d3" returned: 0 in 0.319s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-02068882-78c1-42f6-9b81-74bb44efb6d3" released by "delete_volume" :: held 0.871s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] Created reservations ['92bf4a7e-8d29-4e6d-88a1-ed09c86faa74', 'ea89e43a-c9b0-42d2-aead-490e21b04448', '77241f8c-ddfb-44e2-b9e1-3698f208196f', '94071fca-1107-4310-a813-4b110b615297'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:26 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:19:26 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:26 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.326s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:26 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] Deleted volume successfully. Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f75da4ff-98cb-4431-a2b1-44d139764683 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-02068882-78c1-42f6-9b81-74bb44efb6d3-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (1fff2aa7-5349-4f21-a763-efe42d021724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a31e304-2ad7-49d7-927e-9a8238cb5f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a31e304-2ad7-49d7-927e-9a8238cb5f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-786387122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf8319f-5fec-4583-b863-75f841c897cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:27Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1effb77-2fcf-4455-bb96-a5487365326b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1effb77-2fcf-4455-bb96-a5487365326b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193f57fa-0777-44fc-9bbe-a270ab3091de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193f57fa-0777-44fc-9bbe-a270ab3091de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acf8319f-5fec-4583-b863-75f841c897cb', 'volume_name': 'volume-acf8319f-5fec-4583-b863-75f841c897cb', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fb3e11-bcb3-4c7a-8869-6eac7545b032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:26 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fb3e11-bcb3-4c7a-8869-6eac7545b032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2464cfe3-eb87-45bf-9369-2002d6643456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:27 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Volume acf8319f-5fec-4583-b863-75f841c897cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acf8319f-5fec-4583-b863-75f841c897cb', 'volume_size': 1} Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-786387122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf8319f-5fec-4583-b863-75f841c897cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:27Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Creating volume acf8319f-5fec-4583-b863-75f841c897cb {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:27 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:27 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb 1073741824 Jul 21 19:19:27 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:27 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb 1073741824" returned: 0 in 0.498s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:27 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb Jul 21 19:19:27 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:27 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb" returned: 0 in 0.356s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2464cfe3-eb87-45bf-9369-2002d6643456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acf8319f-5fec-4583-b863-75f841c897cb', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2fd6f43-62c7-4717-94c2-998769740c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:27 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Volume volume-acf8319f-5fec-4583-b863-75f841c897cb (acf8319f-5fec-4583-b863-75f841c897cb): created successfully Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2fd6f43-62c7-4717-94c2-998769740c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:27 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (1fff2aa7-5349-4f21-a763-efe42d021724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:27 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-45e046c8-ca1b-49ac-8bee-1f7170b44a0b tempest-ProjectMemberTests-1649818385 None] Created volume successfully. Jul 21 19:19:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:29 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] Creating offline snapshot 6c711a26-2ea7-47f3-bf03-4a813100f55e of volume acf8319f-5fec-4583-b863-75f841c897cb {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:19:29 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afc0428-fdfe-4954-8916-4bf4cb17e631]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:29 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb Jul 21 19:19:29 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:29 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb" returned: 0 in 0.412s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:29 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e 1G Jul 21 19:19:29 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:30 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e 1G" returned: 0 in 0.485s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acf8319f-5fec-4583-b863-75f841c897cb -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:30 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acf8319f-5fec-4583-b863-75f841c897cb -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e Jul 21 19:19:30 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:30 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acf8319f-5fec-4583-b863-75f841c897cb -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e" returned: 0 in 0.330s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:30 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e is being set with open permissions: ugo+rw Jul 21 19:19:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:30 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e Jul 21 19:19:30 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:30 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e" returned: 0 in 0.259s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:30 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.info Jul 21 19:19:30 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:30 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.info" returned: 0 in 0.245s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:30 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.info is being set with open permissions: ugo+rw Jul 21 19:19:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:31 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.info Jul 21 19:19:31 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:31 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.info" returned: 0 in 0.241s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:31 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0cb46895-799c-4e21-98a2-66ca66cec180 tempest-ProjectMemberTests-1649818385 None] Create snapshot completed successfully Jul 21 19:19:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-6c711a26-2ea7-47f3-bf03-4a813100f55e-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-6c711a26-2ea7-47f3-bf03-4a813100f55e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-acf8319f-5fec-4583-b863-75f841c897cb" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-acf8319f-5fec-4583-b863-75f841c897cb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-6c711a26-2ea7-47f3-bf03-4a813100f55e" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:32 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-6c711a26-2ea7-47f3-bf03-4a813100f55e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:32 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] Deleting offline snapshot 6c711a26-2ea7-47f3-bf03-4a813100f55e of volume acf8319f-5fec-4583-b863-75f841c897cb {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:19:32 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] snapshot_file for this snap is: volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:19:32 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da24950-5eea-45ac-ba02-ecf5b5364d97]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:32 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e Jul 21 19:19:32 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:32 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e" returned: 0 in 0.426s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:32 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acf8319f-5fec-4583-b863-75f841c897cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:19:32 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[e744b98f-19ba-4d10-9f20-4d0748ef7808]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:33 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb Jul 21 19:19:33 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:33 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb" returned: 0 in 0.431s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:33 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e Jul 21 19:19:33 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:33 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e" returned: 0 in 0.394s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:33 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e Jul 21 19:19:33 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:34 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb.6c711a26-2ea7-47f3-bf03-4a813100f55e" returned: 0 in 0.256s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-6c711a26-2ea7-47f3-bf03-4a813100f55e" released by "_delete_snapshot" :: held 1.609s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-acf8319f-5fec-4583-b863-75f841c897cb" released by "delete_snapshot" :: held 1.634s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:34 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] Created reservations ['9004fc33-c72b-46a6-86f8-52fb38bedf48', '13974d28-da47-487a-b545-377522686b70', '246eb9d2-ca66-4905-a5f8-f07034e3e805', '8cbb0f50-659e-4b38-91cc-e36ba0e18f69'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:34 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] Delete snapshot completed successfully. Jul 21 19:19:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-cdb05973-f996-4aad-ab45-0e72ad4a8369 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-6c711a26-2ea7-47f3-bf03-4a813100f55e-delete_snapshot" released by "delete_snapshot" :: held 1.770s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-acf8319f-5fec-4583-b863-75f841c897cb-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-acf8319f-5fec-4583-b863-75f841c897cb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-acf8319f-5fec-4583-b863-75f841c897cb" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:34 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-acf8319f-5fec-4583-b863-75f841c897cb" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:34 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9072d5c3-83ed-44a6-8e14-bb2ed3b46032]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:34 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb Jul 21 19:19:34 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:35 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb" returned: 0 in 0.359s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:35 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb Jul 21 19:19:35 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:35 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-acf8319f-5fec-4583-b863-75f841c897cb" returned: 0 in 0.239s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-acf8319f-5fec-4583-b863-75f841c897cb" released by "delete_volume" :: held 0.652s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:35 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] Created reservations ['05617d2b-78d9-4203-a254-b2ec02dfda2c', '58e582c9-8f60-4022-a8d7-8ea06cf53986', '98a6d1ba-0847-49e3-99d7-ba57bb5c5bdf', '8a3e0183-92d9-4e3b-8e81-cb210b6c8f69'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:35 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:19:35 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:35 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.239s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:35 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:35 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] Deleted volume successfully. Jul 21 19:19:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-9816cf8c-d205-4cd5-95eb-25f91a452956 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-acf8319f-5fec-4583-b863-75f841c897cb-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (5a1b38fd-03c5-42af-af57-f913d2f00518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2044ec30-288b-449c-82e6-7ee462aff6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2044ec30-288b-449c-82e6-7ee462aff6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1758351584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942103d2-dcad-4a9f-9099-930f8d7ef922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:36Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0507a28-2696-4a66-a111-0e0ed3b4b26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0507a28-2696-4a66-a111-0e0ed3b4b26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99554711-a40c-4d34-9980-93051deefbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99554711-a40c-4d34-9980-93051deefbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '942103d2-dcad-4a9f-9099-930f8d7ef922', 'volume_name': 'volume-942103d2-dcad-4a9f-9099-930f8d7ef922', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0070440-fb2c-496a-b17b-3f14b1318462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0070440-fb2c-496a-b17b-3f14b1318462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35b192c6-13b2-4362-810a-f9312d51c473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Volume 942103d2-dcad-4a9f-9099-930f8d7ef922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-942103d2-dcad-4a9f-9099-930f8d7ef922', 'volume_size': 1} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1758351584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942103d2-dcad-4a9f-9099-930f8d7ef922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:36Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Creating volume 942103d2-dcad-4a9f-9099-930f8d7ef922 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:36 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:36 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922 1073741824 Jul 21 19:19:36 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:36 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922 1073741824" returned: 0 in 0.411s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:36 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922 Jul 21 19:19:36 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:36 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922" returned: 0 in 0.242s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35b192c6-13b2-4362-810a-f9312d51c473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-942103d2-dcad-4a9f-9099-930f8d7ef922', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ed4555-c0e8-4139-a04d-5ed29d93195f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Volume volume-942103d2-dcad-4a9f-9099-930f8d7ef922 (942103d2-dcad-4a9f-9099-930f8d7ef922): created successfully Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ed4555-c0e8-4139-a04d-5ed29d93195f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (5a1b38fd-03c5-42af-af57-f913d2f00518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:36 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-3d47adc0-8961-499e-9937-b9f3f97c19c8 tempest-ProjectMemberTests-1649818385 None] Created volume successfully. Jul 21 19:19:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:37 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] Creating offline snapshot 8d1c2a25-6a61-4858-998a-3fe4f972ab1b of volume 942103d2-dcad-4a9f-9099-930f8d7ef922 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:19:37 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea88ddd6-3eb3-4824-84c0-f361218b5b6d]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:37 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922 Jul 21 19:19:37 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:37 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922" returned: 0 in 0.361s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:37 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b 1G Jul 21 19:19:37 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:38 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b 1G" returned: 0 in 0.427s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-942103d2-dcad-4a9f-9099-930f8d7ef922 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:38 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-942103d2-dcad-4a9f-9099-930f8d7ef922 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b Jul 21 19:19:38 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:38 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-942103d2-dcad-4a9f-9099-930f8d7ef922 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b" returned: 0 in 0.288s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:38 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b is being set with open permissions: ugo+rw Jul 21 19:19:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:38 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b Jul 21 19:19:38 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:38 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b" returned: 0 in 0.270s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:38 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.info Jul 21 19:19:38 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:38 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.info" returned: 0 in 0.259s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:38 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.info is being set with open permissions: ugo+rw Jul 21 19:19:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:38 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.info Jul 21 19:19:39 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:39 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.info" returned: 0 in 0.256s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.943s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:39 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-d5d0878b-f565-4340-92e9-849df82943dd tempest-ProjectMemberTests-1649818385 None] Create snapshot completed successfully Jul 21 19:19:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-8d1c2a25-6a61-4858-998a-3fe4f972ab1b-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-8d1c2a25-6a61-4858-998a-3fe4f972ab1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-942103d2-dcad-4a9f-9099-930f8d7ef922" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-942103d2-dcad-4a9f-9099-930f8d7ef922" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-8d1c2a25-6a61-4858-998a-3fe4f972ab1b" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:39 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-8d1c2a25-6a61-4858-998a-3fe4f972ab1b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] Deleting offline snapshot 8d1c2a25-6a61-4858-998a-3fe4f972ab1b of volume 942103d2-dcad-4a9f-9099-930f8d7ef922 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:19:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] snapshot_file for this snap is: volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:19:39 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b1b6a4-abe2-4cda-b286-f3f9b6bbd9fd]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:39 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b Jul 21 19:19:39 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:39 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b" returned: 0 in 0.401s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:39 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-942103d2-dcad-4a9f-9099-930f8d7ef922(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:19:39 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fe71b8-5bab-4682-9a90-d67cd3e73477]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:39 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:40 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922 Jul 21 19:19:40 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:40 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922" returned: 0 in 0.353s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:40 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b Jul 21 19:19:40 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:40 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b" returned: 0 in 0.352s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:40 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b Jul 21 19:19:40 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:40 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:40 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922.8d1c2a25-6a61-4858-998a-3fe4f972ab1b" returned: 0 in 0.251s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:40 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-8d1c2a25-6a61-4858-998a-3fe4f972ab1b" released by "_delete_snapshot" :: held 1.452s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:40 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-942103d2-dcad-4a9f-9099-930f8d7ef922" released by "delete_snapshot" :: held 1.477s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:41 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] Created reservations ['c06699bf-992f-4fc5-bd2c-70eca0687412', '78365bc4-bc51-4ce4-9bfd-d01c1a854a23', '79f52a6c-89f7-48eb-9010-9e98772185a7', '9edd3835-4806-48b3-bfc0-b84f7e9b68f8'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:41 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] Delete snapshot completed successfully. Jul 21 19:19:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-88ddb1dd-892a-408b-b713-47edb6326793 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-8d1c2a25-6a61-4858-998a-3fe4f972ab1b-delete_snapshot" released by "delete_snapshot" :: held 1.626s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-942103d2-dcad-4a9f-9099-930f8d7ef922-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] Lock "cinder-942103d2-dcad-4a9f-9099-930f8d7ef922-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-942103d2-dcad-4a9f-9099-930f8d7ef922" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:41 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-942103d2-dcad-4a9f-9099-930f8d7ef922" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:41 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4db8ce6-7795-4275-9434-7a641f3d2ca5]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:41 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:41 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922 Jul 21 19:19:41 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:42 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922" returned: 0 in 0.362s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:42 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922 Jul 21 19:19:42 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:42 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-942103d2-dcad-4a9f-9099-930f8d7ef922" returned: 0 in 0.251s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-942103d2-dcad-4a9f-9099-930f8d7ef922" released by "delete_volume" :: held 0.669s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:42 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] Created reservations ['030c9a80-ce98-4e70-84b7-658eb12669f7', 'c5df2a9f-ba40-46cc-a463-d9e2899af074', 'c88cdd7f-6c4c-4e7b-aa78-21e2d7c7de58', '4fdb807f-8604-4bcb-a7ef-bae9319926c5'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:42 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:42 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:19:42 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:42 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:42 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.248s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:42 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:42 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] Deleted volume successfully. Jul 21 19:19:42 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-51cd6de9-6201-43cc-893e-f283d4535dad tempest-ProjectMemberTests-1649818385 None] Lock "cinder-942103d2-dcad-4a9f-9099-930f8d7ef922-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (4cd9151b-1c51-48cb-b598-8156ca9841f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37824633-0106-4d7f-a9f2-adf3416dfcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37824633-0106-4d7f-a9f2-adf3416dfcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-119126339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35db322b-f024-4859-b667-a0b0ab606fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:43Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8bd7472-8949-43a2-afb3-193f2c4de035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8bd7472-8949-43a2-afb3-193f2c4de035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63e4f58-de58-4fdc-b031-a63de56ef260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63e4f58-de58-4fdc-b031-a63de56ef260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35db322b-f024-4859-b667-a0b0ab606fce', 'volume_name': 'volume-35db322b-f024-4859-b667-a0b0ab606fce', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db0aeb8-e6fb-4d93-b0a0-87a21b1999b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db0aeb8-e6fb-4d93-b0a0-87a21b1999b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68e0fb4-4bc3-4b1e-b23c-55034296fff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:43 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Volume 35db322b-f024-4859-b667-a0b0ab606fce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35db322b-f024-4859-b667-a0b0ab606fce', 'volume_size': 1} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-119126339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35db322b-f024-4859-b667-a0b0ab606fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:43Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Creating volume 35db322b-f024-4859-b667-a0b0ab606fce {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:43 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:43 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce 1073741824 Jul 21 19:19:43 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:43 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce 1073741824" returned: 0 in 0.431s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:43 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:43 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce Jul 21 19:19:43 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:43 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce" returned: 0 in 0.252s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68e0fb4-4bc3-4b1e-b23c-55034296fff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35db322b-f024-4859-b667-a0b0ab606fce', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb550b09-8f1a-4413-94d4-1118499c1f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:44 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Volume volume-35db322b-f024-4859-b667-a0b0ab606fce (35db322b-f024-4859-b667-a0b0ab606fce): created successfully Jul 21 19:19:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb550b09-8f1a-4413-94d4-1118499c1f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:44 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (4cd9151b-1c51-48cb-b598-8156ca9841f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:44 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-31ee4b5d-7307-432b-bff6-4d0cb515af77 tempest-ProjectMemberTests-1649818385 None] Created volume successfully. Jul 21 19:19:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:44 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] Creating offline snapshot 05a54198-8e63-4b5b-be9c-8861bcce5c62 of volume 35db322b-f024-4859-b667-a0b0ab606fce {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:19:44 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[92689789-4309-4efd-aa0c-7a12d6e1da89]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:44 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce Jul 21 19:19:44 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:44 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce" returned: 0 in 0.359s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:44 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:44 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62 1G Jul 21 19:19:44 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:45 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62 1G" returned: 0 in 0.374s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35db322b-f024-4859-b667-a0b0ab606fce -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:45 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35db322b-f024-4859-b667-a0b0ab606fce -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62 Jul 21 19:19:45 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:45 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35db322b-f024-4859-b667-a0b0ab606fce -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62" returned: 0 in 0.276s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:45 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62 is being set with open permissions: ugo+rw Jul 21 19:19:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:45 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62 Jul 21 19:19:45 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:45 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62" returned: 0 in 0.237s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:45 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.info Jul 21 19:19:45 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:45 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.info" returned: 0 in 0.243s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:45 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.info is being set with open permissions: ugo+rw Jul 21 19:19:45 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:45 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.info Jul 21 19:19:45 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:46 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.info" returned: 0 in 0.249s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.816s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:46 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-13c50f33-cbd5-49ca-aa26-ca4aae064db9 tempest-ProjectMemberTests-1649818385 None] Create snapshot completed successfully Jul 21 19:19:46 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-05a54198-8e63-4b5b-be9c-8861bcce5c62-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:46 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-05a54198-8e63-4b5b-be9c-8861bcce5c62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:46 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-35db322b-f024-4859-b667-a0b0ab606fce" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:46 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-35db322b-f024-4859-b667-a0b0ab606fce" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:46 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-05a54198-8e63-4b5b-be9c-8861bcce5c62" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:46 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-05a54198-8e63-4b5b-be9c-8861bcce5c62" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] Deleting offline snapshot 05a54198-8e63-4b5b-be9c-8861bcce5c62 of volume 35db322b-f024-4859-b667-a0b0ab606fce {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:19:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] snapshot_file for this snap is: volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:19:46 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4fde87-4343-4e4b-abc4-140d79fe6e67]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:46 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62 Jul 21 19:19:46 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:46 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62" returned: 0 in 0.350s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:46 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35db322b-f024-4859-b667-a0b0ab606fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:19:46 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a9185d-4add-4791-83c7-ad98bfb38b35]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:46 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:47 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce Jul 21 19:19:47 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:47 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce" returned: 0 in 0.348s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:47 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62 Jul 21 19:19:47 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:47 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62" returned: 0 in 0.323s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:47 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62 Jul 21 19:19:47 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:47 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:47 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce.05a54198-8e63-4b5b-be9c-8861bcce5c62" returned: 0 in 0.232s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-05a54198-8e63-4b5b-be9c-8861bcce5c62" released by "_delete_snapshot" :: held 1.338s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:47 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-35db322b-f024-4859-b667-a0b0ab606fce" released by "delete_snapshot" :: held 1.361s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:47 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] Created reservations ['5244bf97-7c90-4080-8f5f-8a715478b8db', 'af23ecd3-c7b1-4a6c-8198-dc09ab7d88e6', '6af51553-2cae-4bbb-aee5-ae7fece2434a', 'e18e242b-623b-4b93-a2bf-05f4fdee5272'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:48 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] Delete snapshot completed successfully. Jul 21 19:19:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f89b06fd-1b9c-411f-8624-27ff912be825 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-05a54198-8e63-4b5b-be9c-8861bcce5c62-delete_snapshot" released by "delete_snapshot" :: held 1.482s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-35db322b-f024-4859-b667-a0b0ab606fce-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] Lock "cinder-35db322b-f024-4859-b667-a0b0ab606fce-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-35db322b-f024-4859-b667-a0b0ab606fce" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:48 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-35db322b-f024-4859-b667-a0b0ab606fce" acquired by "delete_volume" :: waited 0.014s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:48 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e1713f-55a0-4535-bba2-8be08a720df1]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:48 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:48 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce Jul 21 19:19:48 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:49 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce" returned: 0 in 0.343s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:49 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce Jul 21 19:19:49 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:49 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-35db322b-f024-4859-b667-a0b0ab606fce" returned: 0 in 0.237s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:49 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-35db322b-f024-4859-b667-a0b0ab606fce" released by "delete_volume" :: held 0.633s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:49 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] Created reservations ['09cf5ace-7ceb-4e7f-8718-8998c1088242', '36c7a879-e893-4246-bd61-407c80ca6994', '7618760b-5769-4fdf-b9f3-cf91ccca8a70', 'd974c666-278f-4a3b-8876-c6fa2a777dff'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:49 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:49 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:19:49 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:49 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:49 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.234s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:49 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:49 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] Deleted volume successfully. Jul 21 19:19:49 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-624e0a79-b21c-4641-a65d-a36efad96faa tempest-ProjectMemberTests-1649818385 None] Lock "cinder-35db322b-f024-4859-b667-a0b0ab606fce-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (67b5dc1b-69be-4fe9-bef1-addd937fbc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2215210-70b7-4c14-b4fb-d3ebad65ca79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2215210-70b7-4c14-b4fb-d3ebad65ca79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-224032715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb153c02-4902-4115-957b-3ce400e2bf9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:50Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb04efa-f5ca-4e8c-a0a7-665a7c1b42cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb04efa-f5ca-4e8c-a0a7-665a7c1b42cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dde7702-ad20-4e51-a8b1-8683140d64e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dde7702-ad20-4e51-a8b1-8683140d64e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb153c02-4902-4115-957b-3ce400e2bf9c', 'volume_name': 'volume-eb153c02-4902-4115-957b-3ce400e2bf9c', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1baafbe3-1a7b-47ce-bbb0-df50b83df0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1baafbe3-1a7b-47ce-bbb0-df50b83df0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f4a177-c6d7-415d-ae0d-4eb3917d177c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:50 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Volume eb153c02-4902-4115-957b-3ce400e2bf9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb153c02-4902-4115-957b-3ce400e2bf9c', 'volume_size': 1} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-224032715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb153c02-4902-4115-957b-3ce400e2bf9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69773071e7845f59f957fd67c776ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:50Z,use_quota=True,user_id='3ff2fa5c4422434bb6792cd84572e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Creating volume eb153c02-4902-4115-957b-3ce400e2bf9c {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:50 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:50 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c 1073741824 Jul 21 19:19:50 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:50 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c 1073741824" returned: 0 in 0.454s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:50 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:50 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c Jul 21 19:19:50 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:51 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c" returned: 0 in 0.254s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f4a177-c6d7-415d-ae0d-4eb3917d177c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb153c02-4902-4115-957b-3ce400e2bf9c', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d14776-ffa9-449e-a693-cd9bd1cf5b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:51 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Volume volume-eb153c02-4902-4115-957b-3ce400e2bf9c (eb153c02-4902-4115-957b-3ce400e2bf9c): created successfully Jul 21 19:19:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d14776-ffa9-449e-a693-cd9bd1cf5b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:51 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Flow 'volume_create_manager' (67b5dc1b-69be-4fe9-bef1-addd937fbc90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:51 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-868674b7-d904-402f-9a99-f1799a3dd294 tempest-ProjectMemberTests-1649818385 None] Created volume successfully. Jul 21 19:19:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:51 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] Creating offline snapshot 8a6544cf-811d-44c2-a456-0ee3fbd44966 of volume eb153c02-4902-4115-957b-3ce400e2bf9c {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:19:51 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fa0284-1c1f-4b38-a505-dc15cecbb658]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:51 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c Jul 21 19:19:51 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:51 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c" returned: 0 in 0.371s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:51 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:51 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966 1G Jul 21 19:19:51 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:52 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966 1G" returned: 0 in 0.390s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb153c02-4902-4115-957b-3ce400e2bf9c -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:52 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb153c02-4902-4115-957b-3ce400e2bf9c -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966 Jul 21 19:19:52 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:52 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb153c02-4902-4115-957b-3ce400e2bf9c -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966" returned: 0 in 0.305s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:52 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966 is being set with open permissions: ugo+rw Jul 21 19:19:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:52 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966 Jul 21 19:19:52 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:52 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966" returned: 0 in 0.259s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:52 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=143,cinder:DELETE=18,cinder:UPDATE=199,cinder:INSERT=49 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:19:52 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:52 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.info Jul 21 19:19:52 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:53 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.info" returned: 0 in 0.266s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:53 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.info is being set with open permissions: ugo+rw Jul 21 19:19:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:53 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.info Jul 21 19:19:53 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:53 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.info" returned: 0 in 0.261s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.937s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:53 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=190,cinder:DELETE=15,cinder:SELECT=150,cinder:INSERT=55 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:19:53 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-394aa316-0760-4180-ac02-b75805b30437 tempest-ProjectMemberTests-1649818385 None] Create snapshot completed successfully Jul 21 19:19:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-8a6544cf-811d-44c2-a456-0ee3fbd44966-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-8a6544cf-811d-44c2-a456-0ee3fbd44966-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-eb153c02-4902-4115-957b-3ce400e2bf9c" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-eb153c02-4902-4115-957b-3ce400e2bf9c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-8a6544cf-811d-44c2-a456-0ee3fbd44966" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:53 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-8a6544cf-811d-44c2-a456-0ee3fbd44966" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] Deleting offline snapshot 8a6544cf-811d-44c2-a456-0ee3fbd44966 of volume eb153c02-4902-4115-957b-3ce400e2bf9c {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:19:53 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] snapshot_file for this snap is: volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:19:53 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ff764e-f872-48c1-ab60-0ce814fc8599]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:53 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:53 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966 Jul 21 19:19:53 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:54 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966" returned: 0 in 0.377s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:54 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb153c02-4902-4115-957b-3ce400e2bf9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:19:54 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5bffed-2eec-406f-992c-c3163aea9fe7]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:54 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c Jul 21 19:19:54 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:54 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c" returned: 0 in 0.355s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:54 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966 Jul 21 19:19:54 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:54 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966" returned: 0 in 0.353s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:54 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:54 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966 Jul 21 19:19:54 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:55 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:55 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c.8a6544cf-811d-44c2-a456-0ee3fbd44966" returned: 0 in 0.285s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-8a6544cf-811d-44c2-a456-0ee3fbd44966" released by "_delete_snapshot" :: held 1.473s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-eb153c02-4902-4115-957b-3ce400e2bf9c" released by "delete_snapshot" :: held 1.497s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:55 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] Created reservations ['d39ba32e-36e4-45ba-9e66-b6bdd2d82ab5', '4152a69f-a841-4d54-8f12-d9d63602ee57', '8e7fb737-29d3-45cd-a771-aa719c5a2ae1', 'e4841e9c-23e1-46d3-9c29-f3fd8921e6e7'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:55 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] Delete snapshot completed successfully. Jul 21 19:19:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0250265d-747b-49e4-a6c2-be4218940b58 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-8a6544cf-811d-44c2-a456-0ee3fbd44966-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-eb153c02-4902-4115-957b-3ce400e2bf9c-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-eb153c02-4902-4115-957b-3ce400e2bf9c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "cinder-quobyte-eb153c02-4902-4115-957b-3ce400e2bf9c" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:55 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-eb153c02-4902-4115-957b-3ce400e2bf9c" acquired by "delete_volume" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6125ff-3db2-43bb-a62e-eb69988ddf56]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:56 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c Jul 21 19:19:56 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:56 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c" returned: 0 in 0.377s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:56 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c Jul 21 19:19:56 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:56 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-eb153c02-4902-4115-957b-3ce400e2bf9c" returned: 0 in 0.268s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-quobyte-eb153c02-4902-4115-957b-3ce400e2bf9c" released by "delete_volume" :: held 0.714s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] Created reservations ['b473a76e-8538-40c7-8b3f-185ba494035d', 'fe770060-8b85-447a-b098-197b1391ea3b', 'f9353576-36e8-4086-ba53-6a40fb062ccf', '465b799f-12b8-4e92-89b7-f58aa334e660'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:56 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:19:56 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:56 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:19:56 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:57 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.274s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:19:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:19:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:19:57 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.291s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:57 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] Deleted volume successfully. Jul 21 19:19:57 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-e400ae59-8224-4183-b355-bcf732b7b8d7 tempest-ProjectMemberTests-1649818385 None] Lock "cinder-eb153c02-4902-4115-957b-3ce400e2bf9c-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Flow 'volume_create_manager' (8684f18a-de08-43c5-b560-ae93a9075bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ec5adf-f855-4dd3-8d30-04775fe3b0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ec5adf-f855-4dd3-8d30-04775fe3b0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-306447808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807bb6cd-41ce-46d5-8766-f5deab2ea494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84234b3e2dfd41c5883d55e1b258f980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:01Z,use_quota=True,user_id='d2166dec4a0f49b8806ef76d9f3428a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f472f6-558c-440c-be6b-695c3d55c6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f472f6-558c-440c-be6b-695c3d55c6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b199d28-a69e-44f1-8706-2704829a9d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b199d28-a69e-44f1-8706-2704829a9d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '807bb6cd-41ce-46d5-8766-f5deab2ea494', 'volume_name': 'volume-807bb6cd-41ce-46d5-8766-f5deab2ea494', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c098fbe-f8bc-4acc-ba04-2511b5d6bdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c098fbe-f8bc-4acc-ba04-2511b5d6bdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102b7e2d-62b9-4d31-be8f-c2b4f146116f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:01 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Volume 807bb6cd-41ce-46d5-8766-f5deab2ea494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-807bb6cd-41ce-46d5-8766-f5deab2ea494', 'volume_size': 1} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-306447808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807bb6cd-41ce-46d5-8766-f5deab2ea494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84234b3e2dfd41c5883d55e1b258f980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:01Z,use_quota=True,user_id='d2166dec4a0f49b8806ef76d9f3428a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Creating volume 807bb6cd-41ce-46d5-8766-f5deab2ea494 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:01 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:01 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494 1073741824 Jul 21 19:20:01 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:01 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494 1073741824" returned: 0 in 0.425s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:01 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494 Jul 21 19:20:01 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:02 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494" returned: 0 in 0.266s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102b7e2d-62b9-4d31-be8f-c2b4f146116f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-807bb6cd-41ce-46d5-8766-f5deab2ea494', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4602d995-37cb-432e-b2d7-d5f1cb4831ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:02 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Volume volume-807bb6cd-41ce-46d5-8766-f5deab2ea494 (807bb6cd-41ce-46d5-8766-f5deab2ea494): created successfully Jul 21 19:20:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4602d995-37cb-432e-b2d7-d5f1cb4831ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Flow 'volume_create_manager' (8684f18a-de08-43c5-b560-ae93a9075bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:02 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-dad9cc41-41a2-4e0f-971f-1cd53bc11361 tempest-ProjectReaderTests-742326954 None] Created volume successfully. Jul 21 19:20:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] Creating offline snapshot 63d3360f-2ee8-4084-9c89-7aef5f11644c of volume 807bb6cd-41ce-46d5-8766-f5deab2ea494 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:20:02 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c74d9f-a660-46b8-b5e8-f4acde431bb2]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:02 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494 Jul 21 19:20:02 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:02 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494" returned: 0 in 0.382s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:02 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c 1G Jul 21 19:20:02 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:03 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c 1G" returned: 0 in 0.442s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807bb6cd-41ce-46d5-8766-f5deab2ea494 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:03 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807bb6cd-41ce-46d5-8766-f5deab2ea494 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c Jul 21 19:20:03 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:03 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807bb6cd-41ce-46d5-8766-f5deab2ea494 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c" returned: 0 in 0.338s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:03 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c is being set with open permissions: ugo+rw Jul 21 19:20:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:03 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c Jul 21 19:20:03 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:03 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c" returned: 0 in 0.259s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:04 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.info Jul 21 19:20:04 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:04 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.info" returned: 0 in 0.288s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:04 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.info is being set with open permissions: ugo+rw Jul 21 19:20:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:04 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.info Jul 21 19:20:04 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:04 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.info" returned: 0 in 0.250s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.049s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:04 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-56c079bb-9d1d-4ca9-ad21-145fe148fac5 tempest-ProjectReaderTests-742326954 None] Create snapshot completed successfully Jul 21 19:20:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-63d3360f-2ee8-4084-9c89-7aef5f11644c-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] Lock "cinder-63d3360f-2ee8-4084-9c89-7aef5f11644c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-quobyte-807bb6cd-41ce-46d5-8766-f5deab2ea494" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-807bb6cd-41ce-46d5-8766-f5deab2ea494" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-quobyte-63d3360f-2ee8-4084-9c89-7aef5f11644c" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-63d3360f-2ee8-4084-9c89-7aef5f11644c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] Deleting offline snapshot 63d3360f-2ee8-4084-9c89-7aef5f11644c of volume 807bb6cd-41ce-46d5-8766-f5deab2ea494 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:20:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] snapshot_file for this snap is: volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:20:05 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f928d4-f207-4968-b858-4d5ebad8e582]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:06 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c Jul 21 19:20:06 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:06 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c" returned: 0 in 0.379s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:06 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-807bb6cd-41ce-46d5-8766-f5deab2ea494(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:06 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[33635238-8c37-4df4-8a7b-ea5597ffa1b0]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:06 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494 Jul 21 19:20:06 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:06 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494" returned: 0 in 0.372s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:06 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c Jul 21 19:20:06 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:07 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c" returned: 0 in 0.362s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:07 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c Jul 21 19:20:07 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:07 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:07 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494.63d3360f-2ee8-4084-9c89-7aef5f11644c" returned: 0 in 0.288s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-63d3360f-2ee8-4084-9c89-7aef5f11644c" released by "_delete_snapshot" :: held 1.496s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-807bb6cd-41ce-46d5-8766-f5deab2ea494" released by "delete_snapshot" :: held 1.522s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:07 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] Created reservations ['ad3b34e5-2712-4355-b244-a4ae15a6b239', '735ce0a4-f1e1-49eb-981b-7570347e4b61', '19117dbd-3929-4aa8-a6f6-2682fcf553b5', '0a09ebdd-385d-46eb-b133-bbc131ea4d80'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:07 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] Delete snapshot completed successfully. Jul 21 19:20:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-a16a034f-3a52-4ee1-a667-06c156ee4f4d tempest-ProjectReaderTests-742326954 None] Lock "cinder-63d3360f-2ee8-4084-9c89-7aef5f11644c-delete_snapshot" released by "delete_snapshot" :: held 1.691s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:07 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-807bb6cd-41ce-46d5-8766-f5deab2ea494-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] Lock "cinder-807bb6cd-41ce-46d5-8766-f5deab2ea494-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-quobyte-807bb6cd-41ce-46d5-8766-f5deab2ea494" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-807bb6cd-41ce-46d5-8766-f5deab2ea494" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:08 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e6b786-6814-49d1-9d1c-219760ab1d21]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:08 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494 Jul 21 19:20:08 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:08 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494" returned: 0 in 0.377s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:08 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494 Jul 21 19:20:08 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:08 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-807bb6cd-41ce-46d5-8766-f5deab2ea494" returned: 0 in 0.276s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:08 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-807bb6cd-41ce-46d5-8766-f5deab2ea494" released by "delete_volume" :: held 0.718s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:08 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] Created reservations ['fbcc7c28-1623-47a4-80bc-59a4d7a93e0a', '69b339bb-9f6e-4162-8d2d-34d701256b03', '4107a623-e277-477e-bf85-9af8199bd2fc', 'ec868e50-6786-4180-bdc3-1336a8bcc59d'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:08 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:08 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:08 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:20:08 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:09 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.271s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:09 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] Deleted volume successfully. Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-1ad02181-dde0-4bdf-b4d5-464f312a9cc4 tempest-ProjectReaderTests-742326954 None] Lock "cinder-807bb6cd-41ce-46d5-8766-f5deab2ea494-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Flow 'volume_create_manager' (99072fd9-e5f0-4016-865c-4a7a24e82403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a527fa-c629-4b10-b990-f8e4cdc184bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a527fa-c629-4b10-b990-f8e4cdc184bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-335379280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483a26d7-ac6f-4aa3-ad3f-f305edbbc194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84234b3e2dfd41c5883d55e1b258f980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:10Z,use_quota=True,user_id='d2166dec4a0f49b8806ef76d9f3428a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7420af0e-e462-4e6a-981d-ef8071ec2b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7420af0e-e462-4e6a-981d-ef8071ec2b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c264c2-098d-4c4f-aa6d-443eb06bd1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c264c2-098d-4c4f-aa6d-443eb06bd1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '483a26d7-ac6f-4aa3-ad3f-f305edbbc194', 'volume_name': 'volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41edb6ff-65e3-4e24-81ce-51b3187f793f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41edb6ff-65e3-4e24-81ce-51b3187f793f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8985eda-0505-4b3e-9895-4ee2be045a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:09 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Volume 483a26d7-ac6f-4aa3-ad3f-f305edbbc194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194', 'volume_size': 1} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-335379280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483a26d7-ac6f-4aa3-ad3f-f305edbbc194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84234b3e2dfd41c5883d55e1b258f980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:10Z,use_quota=True,user_id='d2166dec4a0f49b8806ef76d9f3428a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Creating volume 483a26d7-ac6f-4aa3-ad3f-f305edbbc194 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:09 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:20:09 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:09 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194 1073741824 Jul 21 19:20:09 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:10 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194 1073741824" returned: 0 in 0.461s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:10 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194 Jul 21 19:20:10 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:10 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194" returned: 0 in 0.244s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8985eda-0505-4b3e-9895-4ee2be045a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df268ef-14d7-4bac-917e-accd3a9ece7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:10 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Volume volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194 (483a26d7-ac6f-4aa3-ad3f-f305edbbc194): created successfully Jul 21 19:20:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df268ef-14d7-4bac-917e-accd3a9ece7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:10 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Flow 'volume_create_manager' (99072fd9-e5f0-4016-865c-4a7a24e82403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:10 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-954c92b4-b55c-45ab-bb42-6dd13543d9ba tempest-ProjectReaderTests-742326954 None] Created volume successfully. Jul 21 19:20:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:10 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] Creating offline snapshot e7cf7baa-74c6-4833-91c7-9f91f06c6a2e of volume 483a26d7-ac6f-4aa3-ad3f-f305edbbc194 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:20:10 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd6b084-6a92-498e-9311-314d4d604640]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:11 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194 Jul 21 19:20:11 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:11 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194" returned: 0 in 0.368s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:11 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e 1G Jul 21 19:20:11 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:11 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e 1G" returned: 0 in 0.403s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:11 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e Jul 21 19:20:11 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:11 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e" returned: 0 in 0.306s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:11 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e is being set with open permissions: ugo+rw Jul 21 19:20:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:12 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e Jul 21 19:20:12 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:12 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e" returned: 0 in 0.285s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:12 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.info Jul 21 19:20:12 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:12 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.info" returned: 0 in 0.268s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:12 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.info is being set with open permissions: ugo+rw Jul 21 19:20:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:12 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.info Jul 21 19:20:12 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:12 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.info" returned: 0 in 0.248s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:12 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-a62637e8-9bff-4678-8cc3-21619239bd4d tempest-ProjectReaderTests-742326954 None] Create snapshot completed successfully Jul 21 19:20:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-e7cf7baa-74c6-4833-91c7-9f91f06c6a2e-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] Lock "cinder-e7cf7baa-74c6-4833-91c7-9f91f06c6a2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-quobyte-483a26d7-ac6f-4aa3-ad3f-f305edbbc194" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-483a26d7-ac6f-4aa3-ad3f-f305edbbc194" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-quobyte-e7cf7baa-74c6-4833-91c7-9f91f06c6a2e" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-e7cf7baa-74c6-4833-91c7-9f91f06c6a2e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] Deleting offline snapshot e7cf7baa-74c6-4833-91c7-9f91f06c6a2e of volume 483a26d7-ac6f-4aa3-ad3f-f305edbbc194 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:20:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] snapshot_file for this snap is: volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:20:13 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a975c9-d1a0-48df-a9a6-be59ac6ea556]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:13 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e Jul 21 19:20:13 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:13 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e" returned: 0 in 0.392s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:13 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:13 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[02693d8d-c506-434f-b8c3-5c89d6a9a451]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:13 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194 Jul 21 19:20:13 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:13 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194" returned: 0 in 0.383s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:13 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e Jul 21 19:20:13 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:14 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e" returned: 0 in 0.343s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:14 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e Jul 21 19:20:14 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:14 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194.e7cf7baa-74c6-4833-91c7-9f91f06c6a2e" returned: 0 in 0.265s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:14 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-e7cf7baa-74c6-4833-91c7-9f91f06c6a2e" released by "_delete_snapshot" :: held 1.478s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:14 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-483a26d7-ac6f-4aa3-ad3f-f305edbbc194" released by "delete_snapshot" :: held 1.503s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:14 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] Created reservations ['20fb22fd-8efc-42d8-ae6b-55ce22b25495', '75113c3e-2474-46ca-a99c-73dd92bb593c', '7fb9ba10-b407-4e27-9567-ad154c4a060b', 'e4eb7fc7-1c7e-46c0-a66b-4909c42c0517'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:14 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] Delete snapshot completed successfully. Jul 21 19:20:14 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-4d7a9183-0bb4-48e8-a96a-4cb3bc3125d8 tempest-ProjectReaderTests-742326954 None] Lock "cinder-e7cf7baa-74c6-4833-91c7-9f91f06c6a2e-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-483a26d7-ac6f-4aa3-ad3f-f305edbbc194-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] Lock "cinder-483a26d7-ac6f-4aa3-ad3f-f305edbbc194-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-quobyte-483a26d7-ac6f-4aa3-ad3f-f305edbbc194" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-483a26d7-ac6f-4aa3-ad3f-f305edbbc194" acquired by "delete_volume" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:15 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[654606d5-bfe9-48af-8f50-99c5c26d6359]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:15 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194 Jul 21 19:20:15 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:15 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194" returned: 0 in 0.375s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:15 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194 Jul 21 19:20:15 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:15 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-483a26d7-ac6f-4aa3-ad3f-f305edbbc194" returned: 0 in 0.270s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-483a26d7-ac6f-4aa3-ad3f-f305edbbc194" released by "delete_volume" :: held 0.701s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] Created reservations ['e892df0d-901b-4d38-8279-60d7f0af2ec2', 'c978b669-8a69-4456-995a-161271593258', '108b23bf-75db-4f2a-b17e-192e32de9358', '3c0f356c-ef36-450d-be64-12bd322d0e8e'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:16 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:20:16 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:16 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.249s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:16 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] Deleted volume successfully. Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-77201cda-69eb-410e-a9fb-084cb9ee52dd tempest-ProjectReaderTests-742326954 None] Lock "cinder-483a26d7-ac6f-4aa3-ad3f-f305edbbc194-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Flow 'volume_create_manager' (831f03ea-0b14-4e43-b242-db5b31aa1bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951dcb32-5d02-48a8-89ac-10a8f7928ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951dcb32-5d02-48a8-89ac-10a8f7928ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-545939799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b900dd9-444c-445b-8508-8d3865e49f87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84234b3e2dfd41c5883d55e1b258f980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:17Z,use_quota=True,user_id='d2166dec4a0f49b8806ef76d9f3428a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc7be1c-355b-4878-91bb-d716119cb0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc7be1c-355b-4878-91bb-d716119cb0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e1e6bb-d7ab-4c7c-9f28-42d3dc08351e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e1e6bb-d7ab-4c7c-9f28-42d3dc08351e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b900dd9-444c-445b-8508-8d3865e49f87', 'volume_name': 'volume-5b900dd9-444c-445b-8508-8d3865e49f87', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da074fe9-1d88-4b57-a205-d1798c0b431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da074fe9-1d88-4b57-a205-d1798c0b431c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896de943-5c4c-4d73-8418-9f6c17e95c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:16 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Volume 5b900dd9-444c-445b-8508-8d3865e49f87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b900dd9-444c-445b-8508-8d3865e49f87', 'volume_size': 1} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-545939799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b900dd9-444c-445b-8508-8d3865e49f87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84234b3e2dfd41c5883d55e1b258f980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:17Z,use_quota=True,user_id='d2166dec4a0f49b8806ef76d9f3428a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Creating volume 5b900dd9-444c-445b-8508-8d3865e49f87 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:16 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:20:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:16 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87 1073741824 Jul 21 19:20:16 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:17 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87 1073741824" returned: 0 in 0.457s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:17 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87 Jul 21 19:20:17 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:17 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87" returned: 0 in 0.270s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:17 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896de943-5c4c-4d73-8418-9f6c17e95c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b900dd9-444c-445b-8508-8d3865e49f87', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a7103c-0549-4149-a4a4-d25643ab3be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:17 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Volume volume-5b900dd9-444c-445b-8508-8d3865e49f87 (5b900dd9-444c-445b-8508-8d3865e49f87): created successfully Jul 21 19:20:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a7103c-0549-4149-a4a4-d25643ab3be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:17 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Flow 'volume_create_manager' (831f03ea-0b14-4e43-b242-db5b31aa1bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:17 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-3fa35b2b-3b7f-46ca-9446-7b167c5d4eaa tempest-ProjectReaderTests-742326954 None] Created volume successfully. Jul 21 19:20:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:17 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:18 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] Creating offline snapshot ac8d4489-19b5-4e6b-ba71-81b773463a27 of volume 5b900dd9-444c-445b-8508-8d3865e49f87 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:20:18 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[682cfcb1-90a0-4af7-9cf3-9ab213b8489e]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:18 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87 Jul 21 19:20:18 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:18 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87" returned: 0 in 0.369s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:18 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27 1G Jul 21 19:20:18 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:18 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27 1G" returned: 0 in 0.418s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:18 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b900dd9-444c-445b-8508-8d3865e49f87 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:18 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b900dd9-444c-445b-8508-8d3865e49f87 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27 Jul 21 19:20:18 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:19 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b900dd9-444c-445b-8508-8d3865e49f87 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27" returned: 0 in 0.304s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:19 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27 is being set with open permissions: ugo+rw Jul 21 19:20:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:19 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27 Jul 21 19:20:19 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:19 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27" returned: 0 in 0.250s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:19 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.info Jul 21 19:20:19 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:19 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.info" returned: 0 in 0.299s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:19 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.info is being set with open permissions: ugo+rw Jul 21 19:20:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:19 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.info Jul 21 19:20:19 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:19 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.info" returned: 0 in 0.252s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:19 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:20 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-a46835de-e8b2-40e3-8820-8ff29de80fa3 tempest-ProjectReaderTests-742326954 None] Create snapshot completed successfully Jul 21 19:20:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-ac8d4489-19b5-4e6b-ba71-81b773463a27-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] Lock "cinder-ac8d4489-19b5-4e6b-ba71-81b773463a27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-quobyte-5b900dd9-444c-445b-8508-8d3865e49f87" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-5b900dd9-444c-445b-8508-8d3865e49f87" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-quobyte-ac8d4489-19b5-4e6b-ba71-81b773463a27" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:20 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-ac8d4489-19b5-4e6b-ba71-81b773463a27" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] Deleting offline snapshot ac8d4489-19b5-4e6b-ba71-81b773463a27 of volume 5b900dd9-444c-445b-8508-8d3865e49f87 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:20:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] snapshot_file for this snap is: volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:20:20 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc7d717-1aa8-4963-b664-441326c91b21]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:20 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27 Jul 21 19:20:20 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:20 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27" returned: 0 in 0.370s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:20 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b900dd9-444c-445b-8508-8d3865e49f87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:20 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e369b66-8de7-4db8-a624-7da9f9abc1c5]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:20 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:20 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87 Jul 21 19:20:20 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:21 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87" returned: 0 in 0.364s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:21 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27 Jul 21 19:20:21 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:21 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27" returned: 0 in 0.361s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:21 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27 Jul 21 19:20:21 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:21 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:21 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87.ac8d4489-19b5-4e6b-ba71-81b773463a27" returned: 0 in 0.258s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-ac8d4489-19b5-4e6b-ba71-81b773463a27" released by "_delete_snapshot" :: held 1.446s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-5b900dd9-444c-445b-8508-8d3865e49f87" released by "delete_snapshot" :: held 1.476s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:21 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] Created reservations ['284ee7e9-78f4-463f-addd-021727266277', 'e5776d79-c12b-4d1a-9e53-e2119cb6332a', '2c8b3c93-93f6-43ef-b587-8b5badbcb656', '3de507d3-f129-4e67-a36b-4a6d02b8f699'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:21 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] Delete snapshot completed successfully. Jul 21 19:20:21 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-0dd7542f-c862-4d6f-b54d-24d15d521caa tempest-ProjectReaderTests-742326954 None] Lock "cinder-ac8d4489-19b5-4e6b-ba71-81b773463a27-delete_snapshot" released by "delete_snapshot" :: held 1.622s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-5b900dd9-444c-445b-8508-8d3865e49f87-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] Lock "cinder-5b900dd9-444c-445b-8508-8d3865e49f87-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-quobyte-5b900dd9-444c-445b-8508-8d3865e49f87" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:22 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-5b900dd9-444c-445b-8508-8d3865e49f87" acquired by "delete_volume" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:22 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f1122c-bb59-4ba3-9267-b567299e578c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:22 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87 Jul 21 19:20:22 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:22 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87" returned: 0 in 0.383s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:22 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:22 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87 Jul 21 19:20:22 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:23 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-5b900dd9-444c-445b-8508-8d3865e49f87" returned: 0 in 0.254s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-5b900dd9-444c-445b-8508-8d3865e49f87" released by "delete_volume" :: held 0.695s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:23 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] Created reservations ['a0a4f05e-86bf-4c13-b292-3f59c0df0352', '184d0516-e992-45cb-9cae-8d87e5b27a78', 'de74f90b-8229-4954-9a4a-d61e8f12394b', 'e0e7f9af-06a4-423f-a14c-3b18373aa15c'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:23 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:23 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:20:23 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:23 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:23 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.254s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:23 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:23 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] Deleted volume successfully. Jul 21 19:20:23 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f54205b0-e792-4774-ba30-7c41b16d736b tempest-ProjectReaderTests-742326954 None] Lock "cinder-5b900dd9-444c-445b-8508-8d3865e49f87-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:23 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Flow 'volume_create_manager' (5c90ccc6-5bdf-4611-b615-ee943fc9c32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:23 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f792f32d-65cb-4a95-bea3-e67d5f2047d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f792f32d-65cb-4a95-bea3-e67d5f2047d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1071263303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5b4f23-f9ae-4f4f-991f-35fd059851ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84234b3e2dfd41c5883d55e1b258f980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:24Z,use_quota=True,user_id='d2166dec4a0f49b8806ef76d9f3428a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6cdb867-2493-432a-98e1-230380a39971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6cdb867-2493-432a-98e1-230380a39971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e007d6-2b88-41a6-b1af-ad6395357302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e007d6-2b88-41a6-b1af-ad6395357302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c5b4f23-f9ae-4f4f-991f-35fd059851ba', 'volume_name': 'volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4142197e-3ec2-4d51-831a-bcad2858aadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4142197e-3ec2-4d51-831a-bcad2858aadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554d85c4-7af8-4edb-923a-29501a8ac480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:24 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Volume 1c5b4f23-f9ae-4f4f-991f-35fd059851ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba', 'volume_size': 1} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1071263303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5b4f23-f9ae-4f4f-991f-35fd059851ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84234b3e2dfd41c5883d55e1b258f980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:24Z,use_quota=True,user_id='d2166dec4a0f49b8806ef76d9f3428a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Creating volume 1c5b4f23-f9ae-4f4f-991f-35fd059851ba {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:24 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:24 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba 1073741824 Jul 21 19:20:24 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:24 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba 1073741824" returned: 0 in 0.415s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:24 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba Jul 21 19:20:24 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:24 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba" returned: 0 in 0.254s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554d85c4-7af8-4edb-923a-29501a8ac480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f070d2ec-4dcc-491b-ade2-df2efaf635db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:24 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Volume volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba (1c5b4f23-f9ae-4f4f-991f-35fd059851ba): created successfully Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f070d2ec-4dcc-491b-ade2-df2efaf635db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:24 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Flow 'volume_create_manager' (5c90ccc6-5bdf-4611-b615-ee943fc9c32f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:24 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-e06eb356-b540-40aa-ba54-cecbae49bb1c tempest-ProjectReaderTests-742326954 None] Created volume successfully. Jul 21 19:20:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:25 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] Creating offline snapshot 7534cddd-6e66-4f7e-b44c-3785dddd6c6e of volume 1c5b4f23-f9ae-4f4f-991f-35fd059851ba {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:20:25 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b7bd5d-e319-44c4-8767-cbf7d0e19522]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:25 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba Jul 21 19:20:25 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:25 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba" returned: 0 in 0.372s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:25 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e 1G Jul 21 19:20:25 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:25 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e 1G" returned: 0 in 0.438s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:25 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:25 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e Jul 21 19:20:25 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:26 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e" returned: 0 in 0.313s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:26 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e is being set with open permissions: ugo+rw Jul 21 19:20:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:26 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e Jul 21 19:20:26 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:26 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e" returned: 0 in 0.263s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:26 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.info Jul 21 19:20:26 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:26 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.info" returned: 0 in 0.271s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:26 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.info is being set with open permissions: ugo+rw Jul 21 19:20:26 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:26 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.info Jul 21 19:20:26 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:27 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.info" returned: 0 in 0.242s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.983s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:27 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-786f9194-b678-40de-9aca-6a54d683ef52 tempest-ProjectReaderTests-742326954 None] Create snapshot completed successfully Jul 21 19:20:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-7534cddd-6e66-4f7e-b44c-3785dddd6c6e-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] Lock "cinder-7534cddd-6e66-4f7e-b44c-3785dddd6c6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-quobyte-1c5b4f23-f9ae-4f4f-991f-35fd059851ba" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-1c5b4f23-f9ae-4f4f-991f-35fd059851ba" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-quobyte-7534cddd-6e66-4f7e-b44c-3785dddd6c6e" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:27 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-7534cddd-6e66-4f7e-b44c-3785dddd6c6e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] Deleting offline snapshot 7534cddd-6e66-4f7e-b44c-3785dddd6c6e of volume 1c5b4f23-f9ae-4f4f-991f-35fd059851ba {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:20:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] snapshot_file for this snap is: volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:20:27 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[795d7f2a-f56b-4290-929a-f8bc20d0b055]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:27 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e Jul 21 19:20:27 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:27 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e" returned: 0 in 0.372s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:27 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:27 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5c5090-fa27-46fc-8aca-773d1c2e49f0]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:27 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:27 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba Jul 21 19:20:27 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:28 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba" returned: 0 in 0.385s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:28 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e Jul 21 19:20:28 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:28 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e" returned: 0 in 0.341s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:28 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e Jul 21 19:20:28 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:28 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:28 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba.7534cddd-6e66-4f7e-b44c-3785dddd6c6e" returned: 0 in 0.264s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-7534cddd-6e66-4f7e-b44c-3785dddd6c6e" released by "_delete_snapshot" :: held 1.460s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-1c5b4f23-f9ae-4f4f-991f-35fd059851ba" released by "delete_snapshot" :: held 1.482s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:28 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] Created reservations ['5156a3fb-b326-402a-a175-bf2b2949747c', '122dc8e7-4dda-4b6e-9489-43466931c2f1', 'e3cef35a-ca73-415a-9270-0c9781d93675', 'b60547ae-a4fd-4465-8854-39f08eb4324d'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:28 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] Delete snapshot completed successfully. Jul 21 19:20:28 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-f905862a-6c00-4254-af04-a41c97afda51 tempest-ProjectReaderTests-742326954 None] Lock "cinder-7534cddd-6e66-4f7e-b44c-3785dddd6c6e-delete_snapshot" released by "delete_snapshot" :: held 1.635s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-1c5b4f23-f9ae-4f4f-991f-35fd059851ba-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] Lock "cinder-1c5b4f23-f9ae-4f4f-991f-35fd059851ba-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-quobyte-1c5b4f23-f9ae-4f4f-991f-35fd059851ba" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:29 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-1c5b4f23-f9ae-4f4f-991f-35fd059851ba" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:29 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0b1ac5-f086-4393-844a-e49570b645c1]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:29 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba Jul 21 19:20:29 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:29 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba" returned: 0 in 0.356s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:29 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:29 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba Jul 21 19:20:29 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:30 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-1c5b4f23-f9ae-4f4f-991f-35fd059851ba" returned: 0 in 0.266s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-1c5b4f23-f9ae-4f4f-991f-35fd059851ba" released by "delete_volume" :: held 0.685s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:30 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] Created reservations ['ec9fcc93-ba50-4bfd-a1a3-4681873e8222', '029ebecc-527e-4ce9-81ee-af2d90bd9afa', '45f72d0d-0e32-4492-bb9c-ba7767859e38', 'dd517d5b-8d2f-45b3-b272-97c3f32c2202'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:30 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:30 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:20:30 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:30 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:30 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.277s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:30 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:30 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] Deleted volume successfully. Jul 21 19:20:30 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-3bbad75e-07cb-406f-80d7-ec1b593a957d tempest-ProjectReaderTests-742326954 None] Lock "cinder-1c5b4f23-f9ae-4f4f-991f-35fd059851ba-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Flow 'volume_create_manager' (fb515a2f-88c4-4006-8c46-974bcc8bfb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5259b25e-f93a-42b8-822b-1ce8ace8d635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5259b25e-f93a-42b8-822b-1ce8ace8d635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2111296003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930583b4-f4c4-4788-9e3f-43a0d91e25da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84234b3e2dfd41c5883d55e1b258f980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:31Z,use_quota=True,user_id='d2166dec4a0f49b8806ef76d9f3428a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5479b8cb-aac9-431c-843f-528ac4966266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5479b8cb-aac9-431c-843f-528ac4966266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb04749-5828-4033-96d6-dde1b2be577b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb04749-5828-4033-96d6-dde1b2be577b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '930583b4-f4c4-4788-9e3f-43a0d91e25da', 'volume_name': 'volume-930583b4-f4c4-4788-9e3f-43a0d91e25da', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55646792-44a6-41b8-88e3-4eb13131085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55646792-44a6-41b8-88e3-4eb13131085e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbed621a-dac4-4f8a-a1ea-77bbf36513c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:31 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Volume 930583b4-f4c4-4788-9e3f-43a0d91e25da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-930583b4-f4c4-4788-9e3f-43a0d91e25da', 'volume_size': 1} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2111296003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930583b4-f4c4-4788-9e3f-43a0d91e25da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84234b3e2dfd41c5883d55e1b258f980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:31Z,use_quota=True,user_id='d2166dec4a0f49b8806ef76d9f3428a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Creating volume 930583b4-f4c4-4788-9e3f-43a0d91e25da {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:31 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:31 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da 1073741824 Jul 21 19:20:31 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:31 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da 1073741824" returned: 0 in 0.425s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:31 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da Jul 21 19:20:31 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:31 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da" returned: 0 in 0.266s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbed621a-dac4-4f8a-a1ea-77bbf36513c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-930583b4-f4c4-4788-9e3f-43a0d91e25da', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902554fc-be74-4d77-b65d-8b6d3a70fd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:31 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Volume volume-930583b4-f4c4-4788-9e3f-43a0d91e25da (930583b4-f4c4-4788-9e3f-43a0d91e25da): created successfully Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902554fc-be74-4d77-b65d-8b6d3a70fd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:31 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Flow 'volume_create_manager' (fb515a2f-88c4-4006-8c46-974bcc8bfb3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:31 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-b2e6825d-9fcd-4266-8cfe-aef7834522e2 tempest-ProjectReaderTests-742326954 None] Created volume successfully. Jul 21 19:20:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:32 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] Creating offline snapshot 88ac533c-26b9-493e-8525-d079608c4f5d of volume 930583b4-f4c4-4788-9e3f-43a0d91e25da {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:20:32 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c64f1af-5296-48c2-a78a-6f76228d4615]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:32 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da Jul 21 19:20:32 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:32 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da" returned: 0 in 0.383s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:32 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:32 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d 1G Jul 21 19:20:32 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:33 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d 1G" returned: 0 in 0.502s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-930583b4-f4c4-4788-9e3f-43a0d91e25da -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:33 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-930583b4-f4c4-4788-9e3f-43a0d91e25da -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d Jul 21 19:20:33 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:33 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-930583b4-f4c4-4788-9e3f-43a0d91e25da -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d" returned: 0 in 0.348s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:33 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d is being set with open permissions: ugo+rw Jul 21 19:20:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:33 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d Jul 21 19:20:33 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:33 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d" returned: 0 in 0.242s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:33 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:33 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.info Jul 21 19:20:33 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:34 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.info" returned: 0 in 0.257s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:34 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.info is being set with open permissions: ugo+rw Jul 21 19:20:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:34 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.info Jul 21 19:20:34 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:34 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.info" returned: 0 in 0.245s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:34 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.060s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:34 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-4b0c3537-eb1c-4dd5-ba5f-bd4978eccd97 tempest-ProjectReaderTests-742326954 None] Create snapshot completed successfully Jul 21 19:20:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-88ac533c-26b9-493e-8525-d079608c4f5d-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] Lock "cinder-88ac533c-26b9-493e-8525-d079608c4f5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-quobyte-930583b4-f4c4-4788-9e3f-43a0d91e25da" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-930583b4-f4c4-4788-9e3f-43a0d91e25da" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-quobyte-88ac533c-26b9-493e-8525-d079608c4f5d" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:35 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-88ac533c-26b9-493e-8525-d079608c4f5d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] Deleting offline snapshot 88ac533c-26b9-493e-8525-d079608c4f5d of volume 930583b4-f4c4-4788-9e3f-43a0d91e25da {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:20:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] snapshot_file for this snap is: volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:20:35 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eda15c-23cf-4a9c-9c42-3ae15f267ee2]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:35 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d Jul 21 19:20:35 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:35 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d" returned: 0 in 0.386s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:35 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-930583b4-f4c4-4788-9e3f-43a0d91e25da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:35 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[37568ae2-f026-44c7-9616-e488e998a2df]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:35 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:36 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da Jul 21 19:20:36 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:36 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da" returned: 0 in 0.403s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:36 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d Jul 21 19:20:36 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:36 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d" returned: 0 in 0.343s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:36 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:36 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d Jul 21 19:20:36 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:37 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da.88ac533c-26b9-493e-8525-d079608c4f5d" returned: 0 in 0.284s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-88ac533c-26b9-493e-8525-d079608c4f5d" released by "_delete_snapshot" :: held 1.518s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-930583b4-f4c4-4788-9e3f-43a0d91e25da" released by "delete_snapshot" :: held 1.541s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:37 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] Created reservations ['d00628d3-f005-4b01-9194-b8621df27260', '658d711f-8d64-4ca1-8cfc-8bd3d4473f5a', 'ab98bf86-3fbe-4c7e-ade7-9b1a94ede681', 'd040801c-2e2f-4de2-8fbf-d2eafd848461'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:37 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] Delete snapshot completed successfully. Jul 21 19:20:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-75a29703-d427-4f54-8760-025f604037c6 tempest-ProjectReaderTests-742326954 None] Lock "cinder-88ac533c-26b9-493e-8525-d079608c4f5d-delete_snapshot" released by "delete_snapshot" :: held 1.701s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-930583b4-f4c4-4788-9e3f-43a0d91e25da-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] Lock "cinder-930583b4-f4c4-4788-9e3f-43a0d91e25da-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] Acquiring lock "cinder-quobyte-930583b4-f4c4-4788-9e3f-43a0d91e25da" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:37 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-930583b4-f4c4-4788-9e3f-43a0d91e25da" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:37 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd30ff2a-0087-4ea8-a929-23bf56617609]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:37 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:37 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da Jul 21 19:20:37 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:38 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da" returned: 0 in 0.395s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:38 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da Jul 21 19:20:38 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:38 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-930583b4-f4c4-4788-9e3f-43a0d91e25da" returned: 0 in 0.263s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:38 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] Lock "cinder-quobyte-930583b4-f4c4-4788-9e3f-43a0d91e25da" released by "delete_volume" :: held 0.719s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:38 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] Created reservations ['2494ef54-cee7-4052-9ac1-7edeaccea75f', 'b437b712-b7b8-4b24-9eb2-0b4ece0dd844', '2538c02c-7f44-4ece-bbf2-c36d2daab266', '33c0f958-e296-4a62-b147-e1c5d1f45d85'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:38 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:38 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:20:38 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:38 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:38 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.267s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:38 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:38 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] Deleted volume successfully. Jul 21 19:20:38 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-648231a1-1483-416c-8c8c-21c51fc69bd2 tempest-ProjectReaderTests-742326954 None] Lock "cinder-930583b4-f4c4-4788-9e3f-43a0d91e25da-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:56 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:20:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:56 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:56 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:56 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:20:56 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:57 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:57 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.284s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:57 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:57 devstack cinder-volume[87570]: DEBUG oslo_service.periodic_task [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87570) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:20:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread count: 28 {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:20:57 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-4104031d-8c0b-4301-bb07-52ae7a0f30b3 None None] thread info: [<_MainThread(MainThread, started 125025358176384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87570) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:20:57 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=87,cinder:INSERT=31,cinder:UPDATE=105,cinder:DELETE=8 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:20:57 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:UPDATE=104,cinder:DELETE=9,cinder:SELECT=73,cinder:INSERT=27 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Flow 'volume_create_manager' (a04ccdbc-a39f-4d4c-bcec-982bc89c5608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40525c5f-f18a-4e39-bec3-ad8870c44fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40525c5f-f18a-4e39-bec3-ad8870c44fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1290192347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc8e1e28-24c2-487e-b92c-369ad9741741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fc80db5cf5493a8840f578a7456db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:21:01Z,use_quota=True,user_id='48c43ded45e5463fa9bf4f642535e395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a587138-8d0f-4d8e-a412-bdf30e541727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a587138-8d0f-4d8e-a412-bdf30e541727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5ae575-b482-458c-bf43-e837858f154c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5ae575-b482-458c-bf43-e837858f154c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc8e1e28-24c2-487e-b92c-369ad9741741', 'volume_name': 'volume-bc8e1e28-24c2-487e-b92c-369ad9741741', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4592fa46-4029-4669-a318-1ad5877e9caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4592fa46-4029-4669-a318-1ad5877e9caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f7901a-bd78-498f-96fa-9bbe8387f13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:01 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Volume bc8e1e28-24c2-487e-b92c-369ad9741741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc8e1e28-24c2-487e-b92c-369ad9741741', 'volume_size': 1} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1290192347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc8e1e28-24c2-487e-b92c-369ad9741741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fc80db5cf5493a8840f578a7456db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:21:01Z,use_quota=True,user_id='48c43ded45e5463fa9bf4f642535e395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)}" {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Creating volume bc8e1e28-24c2-487e-b92c-369ad9741741 {{(pid=87570) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:21:01 devstack cinder-volume[87570]: INFO cinder.volume.drivers.remotefs [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] casted to osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 Jul 21 19:21:01 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 1073741824 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:01 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 1073741824 Jul 21 19:21:01 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:02 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 1073741824" returned: 0 in 0.429s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:02 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 Jul 21 19:21:02 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:02 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741" returned: 0 in 0.243s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'} {{(pid=87570) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:21:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f7901a-bd78-498f-96fa-9bbe8387f13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc8e1e28-24c2-487e-b92c-369ad9741741', 'volume_size': 1}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe013d7-e9dd-4e86-add9-cb61ca1cebf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:02 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Volume volume-bc8e1e28-24c2-487e-b92c-369ad9741741 (bc8e1e28-24c2-487e-b92c-369ad9741741): created successfully Jul 21 19:21:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe013d7-e9dd-4e86-add9-cb61ca1cebf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:02 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Flow 'volume_create_manager' (a04ccdbc-a39f-4d4c-bcec-982bc89c5608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:21:02 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-97c4888b-9803-46de-af51-f66334980494 tempest-SnapshotDependencyTests-1192951652 None] Created volume successfully. Jul 21 19:21:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:02 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] Creating offline snapshot 2c9dbb7b-7785-4de7-be39-91902eb504f2 of volume bc8e1e28-24c2-487e-b92c-369ad9741741 {{(pid=87570) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:21:02 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f67f31-2a28-43c2-8af3-cd814857256c]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:02 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:02 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 Jul 21 19:21:02 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:03 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741" returned: 0 in 0.353s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2 1G {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:03 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2 1G Jul 21 19:21:03 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:03 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2 1G" returned: 0 in 0.380s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc8e1e28-24c2-487e-b92c-369ad9741741 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:03 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc8e1e28-24c2-487e-b92c-369ad9741741 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2 Jul 21 19:21:03 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:03 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc8e1e28-24c2-487e-b92c-369ad9741741 -F qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2" returned: 0 in 0.288s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:03 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2 is being set with open permissions: ugo+rw Jul 21 19:21:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:03 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2 Jul 21 19:21:03 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:03 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:03 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2" returned: 0 in 0.243s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:04 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.info Jul 21 19:21:04 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:04 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.info" returned: 0 in 0.253s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:04 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.info is being set with open permissions: ugo+rw Jul 21 19:21:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.info {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:04 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.info Jul 21 19:21:04 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:04 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.info" returned: 0 in 0.237s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:04 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.839s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:04 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-fcb698ca-aa05-4b51-b365-c17477002206 tempest-SnapshotDependencyTests-1192951652 None] Create snapshot completed successfully Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87570) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Flow 'volume_create_manager' (83c3b5a4-b1f4-4a6a-ac59-7624e45f3a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9ace0d-b7a2-4027-8c0b-f8174684d48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9ace0d-b7a2-4027-8c0b-f8174684d48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d73cf7f-a336-410f-9993-d6694adabfbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fc80db5cf5493a8840f578a7456db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2c9dbb7b-7785-4de7-be39-91902eb504f2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:21:05Z,use_quota=True,user_id='48c43ded45e5463fa9bf4f642535e395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdd25b4-c422-464f-988d-0ba33d79c773),volume_type_id=3fdd25b4-c422-464f-988d-0ba33d79c773)' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e80c5e0-401d-4f31-93b1-8bb7b5210070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e80c5e0-401d-4f31-93b1-8bb7b5210070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87800fd0-2731-4056-8276-0367e3ef1297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87800fd0-2731-4056-8276-0367e3ef1297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d73cf7f-a336-410f-9993-d6694adabfbf', 'volume_name': 'volume-2d73cf7f-a336-410f-9993-d6694adabfbf', 'volume_size': 1, 'snapshot_id': '2c9dbb7b-7785-4de7-be39-91902eb504f2'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be5e40d-20b8-41aa-ab6d-f371379826af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be5e40d-20b8-41aa-ab6d-f371379826af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece830e0-2694-42d3-b141-fa00b5870c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:05 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Volume 2d73cf7f-a336-410f-9993-d6694adabfbf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d73cf7f-a336-410f-9993-d6694adabfbf', 'volume_size': 1, 'snapshot_id': '2c9dbb7b-7785-4de7-be39-91902eb504f2'} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Acquiring lock "cinder-quobyte-2c9dbb7b-7785-4de7-be39-91902eb504f2-2d73cf7f-a336-410f-9993-d6694adabfbf" by "_create_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-quobyte-2c9dbb7b-7785-4de7-be39-91902eb504f2-2d73cf7f-a336-410f-9993-d6694adabfbf" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Creating volume 2d73cf7f-a336-410f-9993-d6694adabfbf from snapshot 2c9dbb7b-7785-4de7-be39-91902eb504f2 {{(pid=87570) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Selected osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933 as target Quobyte volume. {{(pid=87570) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Acquiring lock "cinder-quobyte-2d73cf7f-a336-410f-9993-d6694adabfbf" by "_copy_volume_from_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-quobyte-2d73cf7f-a336-410f-9993-d6694adabfbf" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] snapshot: 2c9dbb7b-7785-4de7-be39-91902eb504f2, volume: 2d73cf7f-a336-410f-9993-d6694adabfbf, {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b3e690-264c-422a-b3d3-11e8f389e176]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:05 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2 Jul 21 19:21:05 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:05 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2" returned: 0 in 0.357s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc8e1e28-24c2-487e-b92c-369ad9741741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Creating direct copy from snapshot {{(pid=87570) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c32d8d-bf1c-4bed-82b6-65580d1ab41a]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:05 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:06 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 Jul 21 19:21:06 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:06 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741" returned: 0 in 0.361s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:06 devstack cinder-volume[87570]: DEBUG cinder.utils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Path /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2d73cf7f-a336-410f-9993-d6694adabfbf not found in is_blk_device check {{(pid=87570) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:21:06 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2d73cf7f-a336-410f-9993-d6694adabfbf {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:06 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2d73cf7f-a336-410f-9993-d6694adabfbf Jul 21 19:21:06 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:10 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2d73cf7f-a336-410f-9993-d6694adabfbf" returned: 0 in 4.175s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:10 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e3ce02-67c6-4191-ab26-207080364bb9]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:10 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 Jul 21 19:21:10 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:10 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741" returned: 0 in 0.531s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:10 devstack cinder-volume[87570]: DEBUG cinder.image.image_utils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Image conversion details: src /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741, size 1024.00 MB, duration 4.18 sec, destination /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2d73cf7f-a336-410f-9993-d6694adabfbf {{(pid=87570) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:21:10 devstack cinder-volume[87570]: INFO cinder.image.image_utils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Converted 1024.00 MB image at 245.16 MB/s Jul 21 19:21:10 devstack cinder-volume[87570]: WARNING cinder.volume.drivers.remotefs [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2d73cf7f-a336-410f-9993-d6694adabfbf is being set with open permissions: ugo+rw Jul 21 19:21:10 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2d73cf7f-a336-410f-9993-d6694adabfbf {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:11 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2d73cf7f-a336-410f-9993-d6694adabfbf Jul 21 19:21:11 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:11 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2d73cf7f-a336-410f-9993-d6694adabfbf" returned: 0 in 0.240s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-quobyte-2d73cf7f-a336-410f-9993-d6694adabfbf" released by "_copy_volume_from_snapshot" :: held 5.751s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-quobyte-2c9dbb7b-7785-4de7-be39-91902eb504f2-2d73cf7f-a336-410f-9993-d6694adabfbf" released by "_create_volume_from_snapshot" :: held 5.781s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:11 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.797s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:11 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece830e0-2694-42d3-b141-fa00b5870c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d73cf7f-a336-410f-9993-d6694adabfbf', 'volume_size': 1, 'snapshot_id': '2c9dbb7b-7785-4de7-be39-91902eb504f2'}' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:11 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd23de4-b522-4cb9-a385-9f563fb19e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:11 devstack cinder-volume[87570]: INFO cinder.volume.flows.manager.create_volume [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Volume volume-2d73cf7f-a336-410f-9993-d6694adabfbf (2d73cf7f-a336-410f-9993-d6694adabfbf): created successfully Jul 21 19:21:11 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd23de4-b522-4cb9-a385-9f563fb19e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87570) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:11 devstack cinder-volume[87570]: DEBUG cinder.volume.manager [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Flow 'volume_create_manager' (83c3b5a4-b1f4-4a6a-ac59-7624e45f3a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87570) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:21:11 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-ce16ef20-5c0d-4079-88d6-1a5b73097731 tempest-SnapshotDependencyTests-1192951652 None] Created volume successfully. Jul 21 19:21:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] Acquiring lock "cinder-2c9dbb7b-7785-4de7-be39-91902eb504f2-delete_snapshot" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-2c9dbb7b-7785-4de7-be39-91902eb504f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:11 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] Acquiring lock "cinder-quobyte-bc8e1e28-24c2-487e-b92c-369ad9741741" by "delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-quobyte-bc8e1e28-24c2-487e-b92c-369ad9741741" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] Acquiring lock "cinder-quobyte-2c9dbb7b-7785-4de7-be39-91902eb504f2" by "_delete_snapshot" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:12 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-quobyte-2c9dbb7b-7785-4de7-be39-91902eb504f2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:12 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] Deleting offline snapshot 2c9dbb7b-7785-4de7-be39-91902eb504f2 of volume bc8e1e28-24c2-487e-b92c-369ad9741741 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:21:12 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] snapshot_file for this snap is: volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2 {{(pid=87570) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:21:12 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[629fb1bc-127e-48a9-8f8f-e40f09101825]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:12 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2 Jul 21 19:21:12 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:12 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2" returned: 0 in 0.359s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:12 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.remotefs [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc8e1e28-24c2-487e-b92c-369ad9741741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87570) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:21:12 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec2ed83-bc4e-4c65-9b5c-53a014ea6cfd]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:12 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 Jul 21 19:21:12 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:12 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741" returned: 0 in 0.384s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:12 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:12 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2 Jul 21 19:21:12 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:13 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2" returned: 0 in 0.351s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:13 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2 Jul 21 19:21:13 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:13 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:13 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741.2c9dbb7b-7785-4de7-be39-91902eb504f2" returned: 0 in 0.247s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-quobyte-2c9dbb7b-7785-4de7-be39-91902eb504f2" released by "_delete_snapshot" :: held 1.449s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-quobyte-bc8e1e28-24c2-487e-b92c-369ad9741741" released by "delete_snapshot" :: held 1.472s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:13 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] Created reservations ['e4a261a6-bd57-476b-a229-3b937c115a12', '9abb68d2-3436-4597-9179-8e4df8296ece', '0d9dc1c3-bc3d-4bef-a480-1f09c5b0e48a', '4e06730c-da4a-4b3b-bf74-388e2970ee1b'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:21:13 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] Delete snapshot completed successfully. Jul 21 19:21:13 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-21b65e5c-ca33-4b94-9b01-06ca5932dc15 tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-2c9dbb7b-7785-4de7-be39-91902eb504f2-delete_snapshot" released by "delete_snapshot" :: held 1.611s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:14 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] Acquiring lock "cinder-bc8e1e28-24c2-487e-b92c-369ad9741741-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:14 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-bc8e1e28-24c2-487e-b92c-369ad9741741-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:14 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] Acquiring lock "cinder-quobyte-bc8e1e28-24c2-487e-b92c-369ad9741741" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:14 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-quobyte-bc8e1e28-24c2-487e-b92c-369ad9741741" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:14 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3565b4-159d-4f52-b0e1-c130f979e102]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:14 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 Jul 21 19:21:14 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:14 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741" returned: 0 in 0.380s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:14 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741 Jul 21 19:21:14 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:14 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:14 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-bc8e1e28-24c2-487e-b92c-369ad9741741" returned: 0 in 0.247s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:14 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-quobyte-bc8e1e28-24c2-487e-b92c-369ad9741741" released by "delete_volume" :: held 0.683s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:14 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] Created reservations ['a528974f-939f-4f18-b14f-ef25ae532c41', '5ac8b5ee-ff05-4712-bea5-8b4d4e1cd1fa', 'de4df21f-c00c-4a18-b4cc-7db7517b7286', '908bf591-3561-433e-8ebc-d0d190809305'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:21:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:15 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:21:15 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:21:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:15 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:21:15 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:15 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.243s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:15 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:21:15 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] Deleted volume successfully. Jul 21 19:21:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-63c8825b-4baa-418f-9c42-c4451a027af0 tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-bc8e1e28-24c2-487e-b92c-369ad9741741-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] Acquiring lock "cinder-2d73cf7f-a336-410f-9993-d6694adabfbf-delete_volume" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-2d73cf7f-a336-410f-9993-d6694adabfbf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] Acquiring lock "cinder-quobyte-2d73cf7f-a336-410f-9993-d6694adabfbf" by "delete_volume" {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:15 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-quobyte-2d73cf7f-a336-410f-9993-d6694adabfbf" acquired by "delete_volume" :: waited 0.018s {{(pid=87570) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:15 devstack cinder-volume[87570]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e5a02d-25e6-41d2-9cd2-69b3245a42b8]: (4, 'qcow2') {{(pid=88308) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2d73cf7f-a336-410f-9993-d6694adabfbf {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:15 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2d73cf7f-a336-410f-9993-d6694adabfbf Jul 21 19:21:15 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:15 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2d73cf7f-a336-410f-9993-d6694adabfbf" returned: 0 in 0.345s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:15 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2d73cf7f-a336-410f-9993-d6694adabfbf {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:15 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2d73cf7f-a336-410f-9993-d6694adabfbf Jul 21 19:21:15 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:16 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366/volume-2d73cf7f-a336-410f-9993-d6694adabfbf" returned: 0 in 0.240s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-quobyte-2d73cf7f-a336-410f-9993-d6694adabfbf" released by "delete_volume" :: held 0.625s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:16 devstack cinder-volume[87570]: DEBUG cinder.quota [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] Created reservations ['2ef928e5-6b9c-4173-9891-409c039b5858', '7970e1a7-d4b5-45f1-8c97-fb3470cb943d', 'a5e0a2f3-d367-4131-8fc9-f8142be05559', 'c8672c15-16df-4929-8b00-73466df2d458'] {{(pid=87570) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:21:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933': None} {{(pid=87570) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:21:16 devstack cinder-volume[87570]: DEBUG cinder.volume.drivers.quobyte [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-59725b9f-2fab-4a00-96a5-dd1b5d30a933'] {{(pid=87570) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:21:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.lockutils [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87570) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:16 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366 Jul 21 19:21:16 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:16 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:16 devstack cinder-volume[87570]: DEBUG oslo_concurrency.processutils [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d86654c0dfb159bd1f691d4a2fe19366" returned: 0 in 0.250s {{(pid=87570) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:16 devstack cinder-volume[87570]: DEBUG cinder.manager [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] Notifying Schedulers of capabilities ... {{(pid=87570) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:21:16 devstack cinder-volume[87570]: INFO cinder.volume.manager [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] Deleted volume successfully. Jul 21 19:21:16 devstack cinder-volume[87570]: DEBUG cinder.coordination [None req-65c351fb-bdb1-48ba-9842-22bf13a1dd2e tempest-SnapshotDependencyTests-1192951652 None] Lock "cinder-2d73cf7f-a336-410f-9993-d6694adabfbf-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87570) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:26 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=21,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=5 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:21:26 devstack cinder-volume[87570]: DEBUG dbcounter [-] [87570] Writing DB stats cinder:SELECT=26,cinder:UPDATE=28,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}